Deep Learning with LLM: A New Paradigm for Financial Market Prediction and Analysis
Abstract
This study presents the development of an AI text generation detection tool based on the Transformer model, aiming to enhance the accuracy of AI text generation detection and provide a reference for future research. The tool employs a series of preprocessing steps on the text, including Unicode normalization, conversion to lowercase, removal of non-alphabetic characters using regular expressions, and the addition of spaces around punctuation marks. It also eliminates leading and trailing spaces, replaces consecutive ellipses with a single space, and connects text segments with a specified delimiter. Subsequently, non-alphabetic characters and redundant spaces are removed, and multiple consecutive spaces are replaced with a single space, followed by a second conversion to lowercase.
The deep learning model integrates layers of LSTM, Transformer, and CNN for text classification and sequence labeling tasks. The training and validation sets demonstrate that the model's loss decreased from 0.127 to 0.005, while the accuracy increased from 94.96% to 99.8%, indicating strong detection and classification capabilities for AI-generated text. The confusion matrix and accuracy metrics of the test set reveal a prediction accuracy of 99% for AI-generated text, with a precision of 0.99, recall of 1, and an F1 score of 0.99, achieving a highly accurate classification. The results suggest that this model holds great potential for widespread application in the field of AI text detection.
How to Cite This Article
Jiarui Rao, Qian Zhang (2025). Deep Learning with LLM: A New Paradigm for Financial Market Prediction and Analysis . International Journal of Multidisciplinary Research and Growth Evaluation (IJMRGE), 6(2), 211-215. DOI: https://doi.org/10.54660/IJMRGE.2025.6.2.211-215
References
- 1. Fama EF, French KR. Commonriskfactorsinthereturnsonstocksandbonds. Journalof Financial Economics.1993;33(1\:356.
- 2. Xu Y, Shan X, Guo M, Gao W, Lin YS. Designandapplicationofexperiencemanagementtoolsfromtheperspectiveofcustomerperceivedvalue: Astudyontheelectricvehiclemarket. World Electric Vehicle Journal.2024;15(8\:378.
- 3. Chen M, Chen Y, Zhang Q. Areviewofenergyconsumptionintheacquisitionofbio-feedstockformicroalgaebiofuelproduction. Sustainability.2021;13(16\:8873.
- 4. Chen M, Chen Y, Zhang Q, Zheng H, Wang B, Xiao M, Qin H, Wu Z, Tan L. Assessingglobalcarbonsequestrationandbioenergypotentialfrommicroalgaecultivationonmarginallandsleveragingmachinelearning, andadaptivefrictionindeeplearning: Enhancingoptimizerswithsigmoidandtanhfunction. Scienceof The Total Environmentand Proceedingsofthe2024IEEE6th International Conferenceon Power, Intelligent Computingand Systems(ICPICS\IEEE;2024.948:174462; p.80913.
- 5. Chen M. Annualprecipitationforecastof Guangzhoubasedongeneticalgorithmandbackpropagationneuralnetwork(GA-BP\. In: International Conferenceon Algorithms, High Performance Computing, and Artificial Intelligence(AHPCAI2021\. SPIE;
- 2021. Vol.12156, p.1826.
- 6. Zhang X, Soe AN, Dong S, Chen M, Wu M, Htwe T. Urbanresiliencethroughgreenroofing: Aliteraturereviewondualenvironmentalbenefits. In: E3SWebof Conferences. EDPSciences;
- 2024. Vol.536, p.01023.
- 7. Dong S, Xu T, Chen M. Solarradiationcharacteristicsin Shanghai. In: Journalof Physics: Conference Series. IOPPublishing;
- 2022. Vol.2351, No.1, p.012016.
- 8. Wang R, Behandish M. Surrogatemodelingforphysicalsystemswithpreservedpropertiesandadjustabletradeoffs. ar Xivpreprintar Xiv:2202.01139.2022.
- 9. Zhang Q, Guan Y, Zhang Z, Dong S, Yuan T, Ruan Z, etal Sustainablemicroalgaecultivation: Acomprehensivereviewofopenandenclosedsystemsforbiofuelandhigh-valuecompoundproduction. In: E3SWebof Conferences. EDPSciences;
- 2024. Vol.577, p.01008.
- 10. Wang R, Shapiro V. Topologicalsemanticsforlumpedparametersystemsmodeling. Advanced Engineering Informatics.2019;42:100958.
- 11. Wang R. Consistencyanalysisbetweenlumpedanddistributedparametermodels. The Universityof Wisconsin-Madison;2021.
- 12. Yang R. Case GPT: Acasereasoningframeworkbasedonlanguagemodelsandretrieval-augmentedgeneration. ar Xivpreprintar Xiv:2407.07913.2024.
- 13. Sun Y, Salami Pargoo N, Jin P, Ortiz J. Optimizingautonomousdrivingforsafety: Ahuman-centricapproachwith LLM-enhanced RLHF. In: Companionofthe2024ACMInternational Joint Conferenceon Pervasiveand Ubiquitous Computing.2024. p.7680.
- 14. Li K, etal Exploringtheimpactofquantumcomputingonmachinelearningperformance.2024.
- 15. Wang Z, etal Researchonautonomousdrivingdecision-makingstrategiesbasedondeepreinforcementlearning. ar Xivpreprintar Xiv:2408.03084.2024.
- 16. Yan H, etal Researchonimagegenerationoptimizationbasedondeeplearning.2024.
- 17. Tang X, etal Researchonheterogeneouscomputationresourceallocationbasedondata-drivenmethod. ar Xivpreprintar Xiv:2408.05671.2024.
- 18. Su PC, etal Amixed-heuristicquantum-inspiredsimplifiedswarmoptimizationalgorithmforschedulingofreal-timetasksinthemultiprocessorsystem. Applied Soft Computing.2022;131:109807.
- 19. Zhao Y, Hu B, Wang S. Predictionof Brentcrudeoilpricebasedon LSTMmodelunderthebackgroundoflow-carbontransition. ar Xivpreprintar Xiv:2409.12376.2024.
- 20. Diao S, etal Ventilatorpressurepredictionusingrecurrentneuralnetwork. ar Xivpreprintar Xiv:2410.06552.2024.
- 21. Zhao Q, Hao Y, Li X. Stockpricepredictionbasedonhybrid CNN-LSTMmodel.2024.
- 22. Yin Z, Hu B, Chen S. Predictingemployeeturnoverinthefinancialcompany: Acomparativestudyof Cat Boostand XGBoostmodels.2024.
- 23. Xu Q, Wang T, Cai X. Energymarketpriceforecastingandfinancialtechnologyriskmanagementbasedongenerative AI. Preprints.
- 2024. Availablefrom: https://doi. org/10.20944/preprints202410.2161. v
- 124. Wu X, Xiao Y, Liu X. Multi-classclassificationofbreastcancergeneexpressionusing PCAand XGBoost. Preprints.
- 2024. Availablefrom: https://doi. org/10.20944/preprints202410.1775. v
- 225. Wang H, Zhang G, Zhao Y, Lai F, Cui W, Xue J, etal RPF-ELD: Regionalpriorfusionusingearlyandlatedistillationforbreastcancerrecognitioninultrasoundimages. Preprints.
- 2024. Availablefrom: https://doi. org/10.20944/preprints202411.1419. v
- 126. Min L, Yu Q, Zhang Y, Zhang K, Hu Y. Financialpredictionusing Deep FM: Loanrepaymentwithattentionandhybridloss. In:20245th International Conferenceon Machine Learningand Computer Application(ICMLCA\. IEEE;2024. p.4403.
- 27. Accuratepredictionoftemperatureindicatorsin Eastern Chinausingamulti-scale CNN-LSTM-Attentionmodel.2024.
- 28. Rao J, Zhang Q, Liu X. Applicationsanalyzinge-commercereviewswithlargelanguagemodels(LLMs\: Amethodologicalexplorationandapplicationinsight. Journalof Artificial Intelligence General Science(JAIGS\.2024;7(1\:20712.
- 29. Zhang Q, etal Sea MNFvs. LDA: Unveilingthepowerofshorttextmininginfinancialmarkets. International Journalof Engineeringand Management Research. International Journalof Multidisciplinary Researchand Growth Evaluationwww. allmultidisciplinaryjournal. com216|Page2024;14(5\:7682.
- 30. Rao J, etal Machinelearninginaction: Topic-centricsentimentanalysisanditsapplications.2024.
- 31. Qian C, etal Weather DG: LLM-assistedproceduralweathergenerationfordomain-generalizedsemanticsegmentation. ar Xivpreprint. ar Xiv:2410.12075.2024.
- 32. Sun Y, Salami Pargoo N, Jin P, Ortiz J. Optimizingautonomousdrivingforsafety: Ahuman-centricapproachwith LLM-enhanced RLHF. In: Companionofthe2024ACMInternational Joint Conferenceon Pervasiveand Ubiquitous Computing.2024. p.7680.
- 33. Li W. Buildinganintelligente-commerceplatform: Fromsystemdesigntomeetinguseremotionalneeds. International Journalof Computer Scienceand Information Technology.2024;4:
- 44955. Availablefrom: https://doi. org/10.62051/ijcsit. v4n3.
- 5134. Lu Y, Wang Y, Parikh D, Khan A, Lu G. Simultaneousdirectdepthestimationandsynthesisstereoforsingleimageplantrootreconstruction. IEEETransactionson Image Processing.2021;30:488393.
- 35. Ling L, Sheng Y, Tu Z, Zhao W, Xin C, Wan K, etal Dl3dv-10k: Alarge-scalescenedatasetfordeeplearning-based3 Dvision. In: Proceedingsofthe IEEE/CVFConferenceon Computer Visionand Pattern Recognition.2024. p.221609.
- 36. Han C, Lu Y, Sun G, Liang JC, Cao Z, Wang Q, etal Prototypicaltransformerasunifiedmotionlearners. ar Xivpreprint. ar Xiv:2406.01559.2024.
- 37. Lu Y, Sun Z, Shao J, Guo Q, Huang Y, Fei S, etal Li DAR-Forest Dataset: Li DARpointcloudsimulationdatasetforforestryapplication. In:2024IEEEConferenceon Virtual Realityand3DUser Interfaces Abstractsand Workshops(VRW\. IEEE;2024. p.1126.
- 38. Lu Y, Wang Y, Parikh D, Xin Y, Lu G. Extendingsinglebeamlidartofullresolutionbyfusingwithsingleimagedepthestimation. In:202025th International Conferenceon Pattern Recognition(ICPR\. IEEE;2021. p.634350.