1. 5-Hydroxytryptamine (5-HT) has been shown to induce contraction of tracheal smooth muscle. However, the mechanisms of action of 5-HT are not known. We therefore investigated the effects of 5-HT on phospholipase C (PLC)-mediated phosphoinositide (PI) hydrolysis and its regulation in canine cultured tracheal smooth muscle cells (TSMCs) labelled with [3H]-inositol. 5-HT-induced inositol phosphates (IPs) accumulation was time- and dose-dependent with a half-maximal response (EC50) and a maximal response at 0.38 +/- 0.05 and 10 microM, respectively. 2. Ketanserin and mianserin (10 and 100 nM), 5-HT2 receptor antagonists, were equipotent in blocking the 5-HT-induced IPs accumulation with pKB values of 8.46 and 8.21, respectively. In contrast, the dose-response curves of 5-HT-induced IPs accumulation were not shifted until the concentrations of NAN-190 and metoclopramide (5-HT1A and 5-HT3 receptor antagonists, respectively) were increased up to 10 microM. 3. Pretreatment of TSMCs with pertussis toxin or cholera toxin did not inhibit the 5-HT-induced IPs accumulation, but partially inhibited the AlF(4-)-induced IPs response. 4. Stimulation of IPs accumulation by 5-HT required the presence of external Ca2+ and was blocked by EGTA. The addition of Ca2+ (3-620 nM) to digitonin-permeabilized TSMCs directly stimulated IPs accumulation. A further Ca(2+)-dependent increase in IPs accumulation was obtained by inclusion of either guanosine 5'-O-(3-thiotriphoshate) (GTP gamma S) or 5-HT. The combination of GTP gamma S and 5-HT elicited an additive effect on IPs accumulation. 5. Treatment with phorbol 12-myristate 13-acetate (PMA, 1 microM, 30 min) abolished the 5-HT-induced IPs accumulation. The concentrations of PMA that gave a half-maximal and maximal inhibition of 5-HT-induced IPs accumulation were 2.2 +/- 0.4 nM and 1 microM, n = 3, respectively. The protein kinase C (PKC) activator, 4 alpha-phorbol 12,13-didecanoate, at 1 microM, did not influence this response. The inhibitory effect of PMA was reversed by staurosporine, a PKC inhibitor, suggesting that the inhibitory effect of PMA is mediated through the activation of PKC. 6. The site of this inhibition was further investigated by examining the effect of PMA on AlF(4-)-induced IPs accumulation in canine TSMCs. AlF(4-)-stimulated IPs accumulation was inhibited by PMA treatment, suggesting that the effect of PMA is distal to the 5-HT receptor. 7. Acetylcholine-induced IPs accumulation was completely inhibited by atropine, but not affected by ketanserin or mianserin, suggesting that 5-HT-induced IPs accumulation is not due to release of acetylcholine.8. These results demonstrate that 5-HT directly stimulates PLC-mediated PI hydrolysis via a pertussis toxin- and cholera toxin-insensitive GTP binding protein in canine TSMCs and that this coupling process is negatively regulated by PKC. 5-HT2 receptors may be predominantly mediating IPs accumulation and presumably IP-induced Ca2+ release may function as the transducing mechanism for 5-HT stimulated contraction of tracheal smooth muscle.