Chinese Chemical Letters  2013, Vol.24 Issue (10):904-908   PDF    
Application of a new SPA-SVM coupling method for QSPR study of electrophoretic mobilities of some organic and inorganic compounds
Nasser Goudarzia , Mohammad Goodarzib, M. Arab Chamjangalia, M. H. Fatemic    
* Corresponding authors at:a Faculty of Chemistry, Shahrood University of Technology, P.O. Box 316, Shahrood, Iran;
b Department of Chemistry, Faculty of Sciences, Yong Researchers Club, Azad University, Arak, Iran;
c Faculty of Chemistry, Mazandaran University, Babolsar, Iran
Abstract: In this work, two chemometrics methods are applied for the modeling and prediction of electrophoretic mobilities of some organic and inorganic compounds. The successive projection algorithm, feature selection (SPA) strategy, is used as the descriptor selection and model development method. Then, the support vector machine (SVM) and multiple linear regression (MLR) model are utilized to construct the non-linear and linear quantitative structure-property relationship models. The results obtained using the SVM model are compared with those obtained using MLR reveal that the SVM model is of much better predictive value than the MLR one. The root-mean-square errors for the training set and the test set for the SVM model were 0.1911 and 0.2569, respectively, while by the MLR model, they were 0.4908 and 0.6494, respectively. The results show that the SVM model drastically enhances the ability of prediction in QSPR studies and is superior to the MLR model.
Key words: Quantitative structure-mobility     relationship     Support vector machine     Electrophoretic mobility     Successive projection algorithm     Multiple linear regression    

1. Introduction

Capillary electrophoresis (CE) has become an important separation technique and alternate to other analytical methods like high performance liquid chromatography (HPLC) due to its simple preprocessing,high separation efficiency,low operating costs and solvent consumption. It has been applied widely in the analysis of both small and large molecules,such as inorganic ions, organic acids,carbohydrates,pharmaceuticals,and even living cells [1]. Generally,the migration behavior in CE is denoted by electrophoretic mobility (μ),which is dependent on both the molecular structure and separation conditions. Prediction of the mobility of solutes by theoretical methods will relieve analysts of a large number of costly and time-consuming experiments in order to develop a faster optimization process in CE. Many investigators have paid attention to this problem,some of whom have contributed to the study of the quantitative relationship between molecular structures and electrophoretic mobilities. Based upon the published reports,two principal methods can be summarized: the mechanistic and the statistical methods. The mechanistic models are closely related to the mechanisms of electrophoretic separation. The basic expression for such method is Max Born’s model [2]:

where q is the effective charge on the ion,fh is the hydrodynamic friction related to molecular size and shape,and fd lis the dielectric friction caused by the orientation of the solvent dipoles in response to the ionic charge.

Electrophoretic mobility is one of the most important parameters governing the separation of solutes in CE. It is possible to have a sufficient understanding of the separation mechanism and provide a useful tool for a faster method optimization process in CE if a model correlating the migration behavior of an analyte under certain practical conditions to its structural parameters can be developed. During methods development in high-performance capillary electrophoresis (HPCE),the analysts generally have to examine a large number of experiments,which are often costly and time-consuming. Alternatively,quantitative structure-migration relationship (QSMR) provides a promising method for the estimation of analyte mobilities based upon the descriptors derived solely from the molecular structures fit to the experimental data. The advantage of this approach over other methods lies in the fact that it requires only the knowledge of chemical structures, and is not dependent on any experimental properties. The main steps involved in QSMR include data collection,molecular geometry optimization,molecular descriptor generation,descriptor selection,model development,and finally,model performance evaluation [3]. This study can be used to develop a method for prediction of the properties of the new compounds that have not yet been synthesized or found. It can also identify and describe important structural features of the molecules that are relevant to variations in molecular properties,and thus gain some insight into the structural factors affecting solute migration.

Although methods based on the quantitative structure- property relationship have been successfully used to predict many physico-chemical properties,only a few research groups have investigated the quantitative correlation between the analytical parameters and the responses obtained in HPCE [4- 7]. Goudarzi et al.have used least square-support vector machine (LS-SVM) to predict the logarithmic n-octanol/water partition coefficient (log P) of some phenolic derivatives [8]. They have also studied the support vector machine (SVM),principal component regression (PCR),partial least squares (PLS),and multiple linear regression (MLR) to predict pKa of some organic compounds [9]. Fatemi and Goudarzi have utilized MLR and ANN to predict the electrophoretic mobilities of some benzoic acid derivatives in different solvents [10]. There are also several other reports based on quantitative structure-property/activity relationship studies [11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26]

Recently,quantitative structure-property relationship has been involved in modeling to investigate mobility as a property of compounds and the prediction of mobility of new compounds, which is valuable due to low operating costs and the savings of time. In an obvious manner,researchers have paid attention to these studies,especially for drug design. However,many of these studies have been aimed at predicting the ability of the model and not for its validation. Altogether,two parameters are very important for the prediction ability of QSPR studies,one is the descriptors which carry enough information about structures,and the other is the modeling method employed. In this investigation, we introduced SPA (successive projections algorithm) [27] as a feature selection,due to its ability in solving the descriptor selection problems in the QSPR model development.

SPA is a technique specifically designed to select subsets of variables with small collinearity to improve the conditioning of the MLR models. This algorithm was originally proposed for wavelength selection in spectroscopic data sets,especially under conditions of strong spectral overlapping [27]. The MLR models generated using SPA have been shown to be superior,in terms of prediction ability,to full-spectrum PLS (partial least squares) models in a variety of applications including UV-vis [27- 30],ICP-OES [31],FT-IR [32],and NIR spectrometry [33, 34]. SPA has also been successfully employed in various classification studies [35, 36].

SPA comprises three phases [37]. Initially,the algorithm builds candidate subsets of variables on the basis of a co-linearity minimization criterion. Such subsets are constructed according to a sequence of vector projection operations applied to the columns of the matrix of available predictor data. In the second phase,the best candidate subset is chosen according to a criterion that evaluates the prediction ability of the resulting MLR model,such as the root mean square error,defined in a validation set [38]. In the third phase,the selected subset is subjected to an elimination procedure to determine whether any variable can be removed without a significant loss of the prediction ability. Each of these phases has been explained in detail elsewhere [39].

Although SPA was initially designed for use with MLR models,it may be worth investigating whether it could be employed with different modeling techniques. In the present work,the variables selected by SPA will be used to build the MLR and SVM models.

2. Experimental

The experimental electrophoretic mobility (μ) data for some organic and inorganic compounds was used in this work [40]. QSPR model for the estimation of the electrophoretic mobility of these compounds is established in the following six steps: the molecular structure input and generation of the files containing the chemical structures is stored in a computer-readable format; quantum mechanics geometry is optimized with a semi-empirical (AM1) method; structural descriptors are computed; structural descriptors are selected; and the structure-electrophoretic mobility model is generated by multiple linear regression (MLR),support vector machine (SVM) and statistical analysis. The names of the compounds and their experimental and calculated electrophoretic mobility values are shown in Table 1. As it can be seen in Table 1, this set contains a total of 40 sets of electrophoretic mobility data. The electrophoretic mobility values for these compounds were obtained under the same instrumental conditions. The data set was randomly split into a training set and a test set consisting of 30 and 10 members,respectively. The training set was used to adjust the parameters of the model,and the test set of 10 compounds was used to evaluate its predictive ability.

Table 1
Data set with experimental and calculated electrophoretic mobility.
2.1. Descriptor generation and screening

The electrophoretic mobilities of solutes are related to some of their structural,electronic,and geometric properties. The values for these properties can be encoded quantitatively by numerical values,named molecular descriptors. These molecular parameters are to be used to search for the best QSPR model of the electrophoretic mobilities. The 2D structures of the molecules were drawn using the HyperChem 7 software [41]. The final geometries were obtained using the semi-empirical AM1 method in the HyperChem program. The molecular structures were optimized using the Polak-Ribiere algorithm until the root mean square gradient was 0.001 Kcal/mol. The resulting geometries were transferred into the Dragon program package,developed by Milano chemometrics and QSPR group [42],to calculate 1481 descriptors in the constitutional,topological,geometrical,charge, GETAWAY (geometry,topology and atoms-weighted assembly), WHIM (weighted holistic invariant molecular descriptors),3DMoRSE (3D-molecular representation of structure based on electron diffraction),molecular walk count,BCUT,2D-autocorrelation,aromaticity index,randic molecular profile,radial distribution function,functional group,and atom-centered fragment classes.

It is worth mentioning that in the first pre-selected analyses, we removed 647 descriptors because many of them included zero or other constant/near constant values and did not include enough information about structure. On the other hand,to decrease the redundancy existing in the descriptor data matrix, the correlation coefficient,r,of the descriptors with each other was examined,and the co-linear descriptors (with r>0.9) were removed.

Upon application of SPA,eight descriptors were selected for model building. They were mean information index on atomic composition (AAC),3D-MoRSE-signal 18/unweighted (Mor18u),3D-MoRSE-signal 07/weighted by atomic Sanderson electronegativities (Mor07e),Moran autocorrelation-lag1/ weighted by atomic polarizabilities (MATS1p),3D-MoRSEsignal 26/weighted by atomic masses (Mor26m),number of chlorine atoms (nCL),leverage-weighted autocorrelation of lag 4/weighted by atomic masses (HATS4m),and the 2nd component symmetry directional WHIM index/weighted by atomic polarizabilities (G2p).

3. Result and discussion

Prediction ability of the QSAR/QSPR models is affected by two factors. One is the descriptors,which should carry enough information about the molecular structures for interpretation of the activity/ property. The other is the modeling method employed [17]. The number of descriptors available for QSAR/QSPR studies is often so large that it is difficult to obtain a model including all of them. Therefore,identifying important descriptors certainly plays an important role in QSAR/QSPR. Descriptors should represent the maximum information in activity variations,and co-linearity among them must be kept to a minimum.

The correlation matrix for the eight descriptors selected using SPA is shown in Table 2. As it can be seen in this table, there is no significant correlation between the selected descriptors. These descriptors were used for both the linear and non-linear models.

Table 2
Variations of RMSE with different values of C,γ,and ε.

In order to build and test the models,the data set comprising 40 compounds was separated into a training set of 30 compounds and a test set of 10 compounds. Using the training set with the eight selected descriptors,the following linear model was obtained:

It is clear from the molecular descriptors selected in the model that the three parameters included in the descriptors contain polarizability,electronegativity,and atomic masses that affect the mobility of a species present in the descriptors. Also presence of some atoms,such as Cl,can affect the mobility of compounds. The mobilities of compounds in the data set calculated by this equation are shown in Table 1.

The next step was to use SVM as a non-linear modeling tool. The prediction power of SVM is affected by three parameters:γ, C,and ε. These parameters were optimized using the 5-fold cross-validation procedure and the optimal values for these parameters were C=32,γ=0.50,and ε= 0.06. Actually the optimal value for ε is depended on the type of noise in the data, which is usually unknown but there will be some workable careful attention of the number of support vector if enough knowledge of the noise is attainable to select an optimal value for ε. As a matter of fact,choosing the ε value is a critical step because it prevents the entire training set from meeting the boundary conditions,and allows the possibility of sparsity in the dual formulations solution.

To find an optimal value for ε,RMSE for the SVR models with different ε values were calculated,and its optimum value was selected based on minimizing RMSE on the 5-fold cross-validation procedure. The other parameter is the regularized constant,C,that controls the trade-off between maximizing the margin and minimizing the training error. As we have mentioned in our previous research work [8],if C is too large,the SVR model will overfit the training set; likewise,if C is too small,deficient stress will be placed on fitting the training set and it will cause an underfit state on the training set. In order to find an optimal value for C,RMSE for the SVR models with different C values were calculated and the best value for C was selected based on minimizing RMSE on the 5-fold cross-validation procedure. Finally, the γ value was optimized based on high accuracy of 5-fold crossvalidation and minimizing the RMSE. The results obtained indicate that the optimized epsilon value does not differ at this stage, meaning that C and ε are independent from each other. Optimization of the SVM parameters was performed by systemically changing their values in the training step and calculating RMSE of the model. The variations of RMSE with different values of these parameters are shown in Table 3.

Table 3
Correlation matrix for the eight selected descriptors.

The optimized SVM method was then used to calculate the mobility of the data set compounds,and the results were shown in Table 1. We tested the SPA-MLR and SPA-SVM models by using statistical parameters,such as determination coefficients (R2),root mean square error of prediction (RMSEP),relative standard error of prediction (RSEP),and mean absolute error (MAE) values. The statistical results described in Table 4 show that the SPA-SVM model is more reliable than the SPA-MLR one for predicting the mobilities of these class compounds. Fig. 1 shows the plot of experimental values versus predicted values by SVM.

Table 4
Statistical parameters for MLR and SVM models.

Download:
Fig. 1. Plot of the SVM predicting the electrophoretic mobility of training and test sets against the experimental values.
4. Conclusion

In this work,a set of simple and reasonable models was established to estimate the electrophoretic mobilities of some organic and inorganic anions. Also,the successive projection algorithm feature selection (SPA) strategy was used as the descriptor selection. The different structural descriptors employed are very easy to calculate,and the models are physicochemically interpretable. MLR and SVM were used as feature mapping techniques for the prediction of the electrophoretic mobility of these compounds. The results demonstrate the superiority of the SVM model over the MLR one. This is due to the ability of SVM, unlike regression analysis,to allow for flexible mapping of the selected features by implicitly manipulating their functional dependence. Also,the SVM method handles both the linear and non-linear relationships without adding complexity to the model. The descriptors appearing in these QSPR models provide information related to different molecular properties,which can participate in the physicochemical process that affects the electrophoretic mobility of the solute in CE.

*
References
[1] D.A. Kevin, Overview of capillary electrophoresis and capillary electrochromatography, J. Chromatogr. A 856 (1999) 443-463.
[2] R.L. Kay, The current state of our understanding of ionic mobilities, Pure Appl. Chem. 63 (1991) 1393-1399.
[3] A. Yasri, D. Hartsough, Toward an optimal procedure for variable selection and QSAR model building, J. Chem. Inf. Comput. Sci. 41 (2001) 1218-1227.
[4] D. Barŕon Jimenez-Lozano, J. Barbosa, Prediction of electrophoretic behaviour of a series of quinolones in aqueous methanol, J. Chromatogr. A 919 (2001) 395-406.
[5] M. Jalali-Heravi, Z. Garkani-Nejad, Prediction of electrophoretic mobilities of sulfonamides in capillary zone electrophoresis using artificial neural networks, J. Chromatogr. A 927 (2001) 211-218.
[6] Q.F. Li, L.J. Dong, R.P. Jia, et al., Development of a quantitative structure-property relationship model for predicting the electrophoretic mobilities, Comput. Chem. 26 (2002) 245-251.
[7] A. Jouyban, B.H. Yousefi, Quantitative structure property relationship study of electrophoretic mobility of analytes in capillary zone electrophoresis, Comput. Biol. Chem. 27 (2003) 297-303.
[8] N. Goudarzi, M. Goodarzi, Prediction of the logarithmic of partition coefficients (log P) of some organic compounds by least square-support vector machine (LSSVM), Mol. Phys. 106 (2008) 2525-2535.
[9] N. Goudarzi, M. Goodarzi, Prediction of the acidic dissociation constant (pKa) of some organic compounds using linear and nonlinear QSPR methods, Mol. Phys. 107 (2009) 1495-1503.
[10] M.H. Fatemi, N. Goudarzi, Quantitative structure property relationship study of the electrophoretic mobilities of some benzoic acids derivatives in different carrier electrolyte compositions, Electrophoresis 26 (2005) 2968-2973.
[11] N. Goudarzi, M. Goodarzi, QSPR models for prediction of half wave potentials of some chlorinated organic compounds using SR-PLS and GA-PLS methods, Mol. Phys. 107 (2009) 1739-1744.
[12] N. Goudarzi, M. Goodarzi, Prediction of the vapor pressure of some halogenated methyl-phenyl ether (anisole) compounds using linear and nonlinear QSPR methods, Mol. Phys. 107 (2009) 1615-1620.
[13] Z. Elmi, K. Faez, M. Goodarzi, N. Goudarzi, Feature selection method based on fuzzy entropy for regression in QSAR studies, Mol. Phys. 107 (2009) 1787-1798.
[14] N. Goudarzi, M. Goodarzi, M.C.U. Araujo, R.K.H. Galvao, QSPR modeling of soil sorption coefficients (KOC) of pesticides using SPA-ANN and SPA-MLR, J. Agric. Food Chem. 57 (2009) 7153-7158.
[15] N. Goudarzi, M.H. Fatemi, A. Samadi, Quantitative structure-properties relationship study of the 29Si-NMR chemical shifts of some silicate species, Spectrosc. Lett. 42 (2009) 186-193.
[16] M. Goodarzi, M.P. Freitas, Feature selection and linear/nonlinear regression methods for the accurate prediction of glycogen synthase kinase-3B inhibitory activities, QSAR Comb. Sci. 27 (2008) 1092-1098.
[17] M. Goodarzi, M.P. Freitas, Predicting boiling points of aliphatic alcohols through multivariate image analysis applied to quantitative structure-property relationships, J. Phys. Chem. A 112 (2008) 11263-11265.
[18] M. Goodarzi, M.P. Freitas, On the use of PLS and N-PLS inMIA-QSAR: azole antifungals, Chemom. Intell. Lab. Syst. 96 (2008) 59-62.
[19] H. Golmohammadi, M.H. Fatemi, Artificial neural network prediction of retention factors of some benzene derivatives and heterocyclic compounds in micellarelectrokinetic chromatography, Electrophoresis 26 (2005) 3438-3444.
[20] M. Goodarzi, M.P. Freitas, R. Jensen, Feature selection and linear/nonlinear regression methods for the accurate prediction of glycogen synthase kinase-3beta inhibitory activities, J. Chem. Inf. Model 49 (2009) 824-832.
[21] M. Goodarzi, P.R. Duchowicz, C.H. Wu, F.M. Fernández, E.A. Castro, J. Chem. Inf. Model 49 (2009) 1475-1485.
[22] N. Goudarzi, M. Goodarzi, M. Arab Chamjangali, Prediction of inhibition effect of some aliphatic and aromatic organic compounds using QSAR method, J. Environ. Chem. Ecotoxicol. 2 (2010) 47-51.
[23] N. Goudarzi, P. Kalhor, Quantitative structure-retention index relationship (QSRIR) study of monomethylalkanes on the methylsilicone OV-1 stationary phase, Anal. Chem. Lett. 2 (2012) 13-26.
[24] N. Goudarzi, M. Goodarzi, Application of successive projections algorithm(SPA) as a variable selection in a QSPR study to predict the octanol/water partition coefficients (Kow) of some halogenated organic compounds, Anal. Methods 2 (2010) 758-764.
[25] N. Goudarzi, M. Goodarzi, T. Chen, QSAR prediction of HIV inhibition activity of styrylquinoline derivatives by genetic algorithm coupled with multiple linear regressions, Med. Chem. Res. 21 (2012) 437-443.
[26] J. Hosseini, M. Nekoei, M. Mohammadhosseini, N. Goudarzi, Quantitative structure-activity relationship study of arylsulfonylpiperazine inhibitors of 11b-HSD1 by genetic algorithm-multiple linear regression, J. Appl. Res. Chem. 5 (2011) 5-17.
[27] M.C.U. Araujo, T.C.B. Saldanha, R.K.H. Galvão, et al., The successive projections algorithm for variable selection in spectroscopicmulticomponent analysis, Chemom. Intell. Lab. Syst., Lab. Inf. Manage. 57 (2001) 65-73.
[28] A.D.F. Heronides, E.S.O.N. Souza, V. Visani, et al., Simultaneous spectrometric determination of Cu2+, Mn2+ and Zn2+ in polivitaminic/polimineral drug using SPA and GA algorithms for variable selection, J. Braz. Chem. Soc. 16 (2005) 58-61.
[29] M.S. Di Nezio, M.F. Pistonesi, W.D. Fragoso, et al., Successive projections algorithm improving the multivariate simultaneous direct spectrophotometric determination of five phenolic compounds in sea water, Microchem. J. 85 (2007) 194-200.
[30] M. Grunhut, M.E. Centurión, W.D. Fragoso, et al., Flow-batch technique for the simultaneous enzymatic determination of levodopa and carbidopa in pharmaceuticals using PLS and successive projections algorithm, Talanta 75 (2008) 950-958.
[31] R.K.H. Galvão, M.F. Pimentel, M.C.U. Araujo, T. Yoneyama, V. Visani, Aspects of the successive projections algorithm for variable selection in multivariate calibration applied to plasma emission spectrometry, Anal. Chim. Acta 443 (2001) 107-115.
[32] F.A. Honorato, R.K.H. Galvão, M.F. Pimentel, et al., Robust modeling for multivariate calibration transfer by the successive projections algorithm, Chemom. Intell. Lab. Syst., Lab. Inf. Manage. 76 (2005) 65-72.
[33] M.C. Breitkreitz, I.M. Raimundo Jr., J.J.R. Rohwedder, et al., Determination of total sulfur in diesel fuel employing NIR spectroscopy and multivariate calibration, Analyst 128 (2003) 1204-1208.
[34] H.A.D. Dantas Filho, R.K.H. Galvão, M.C.U. Araújo, et al., A strategy for selecting calibration samples for multivariate modelling, Chemom. Intell. Lab. Syst., Lab. Inf. Manage. 72 (2004) 83-91.
[35] M.J.C. Pontes, R.K.H. Galvão, M.C.U. Araújo, et al., The successive projections algorithm for spectral variable selection in classification problems, Chemom. Intell. Lab. Syst. 78 (2005) 11-18.
[36] F.F. Gambarra-Neto, G. Marino, M.C.U. Araújo, et al., Classification of edible vegetable oils using square wave voltammetry with multivariate data, Talanta 77 (2009) 1660-1666.
[37] R.K.H. Galvão, M.C.U. Araújo, W.D. Fragoso, et al., A variable elimination method to improve the parsimony of MLR models using the successive projections algorithm, Chemom. Intell. Lab. Syst. 92 (2008) 83-91.
[38] R.K.H. Galvão, M.C.U. Araújo, E.C. Silva, et al., Cross-validation for the selection of spectral variables using the successive projections algorithm, J. Braz. Chem. Soc. 18 (2007) 1580-1584.
[39] R.K.H. Galvão, M.C.U. Araújo, Linear regression modeling: variable selection, in: S. Brown, R. Tauler, B. Walczak (Eds.), Comprehensive chemometrics, Elsevier, 2009.
[40] S.D. Noblitt, R.L. Mazzoleni, S.V. Hering, et al., Separation of common organic and inorganic anions in atmospheric aerosols using a piperazine buffer and capillary electrophoresis, J. Chromatogr. A 1154 (2007) 400-406.
[41] HyperChem Release 7, HyperCube, Inc., http://www.hyper.com.
[42] R. Todeschini, Milano Chemometrics and QSPR Group, http://www.disat.unimib.it/vhml.