Alberto Ramírez de Aguilar (@arawille) header
Alberto Ramírez de Aguilar (@arawille) profile picture

Theoretical Macroeconomist with interests in Fiscal/Monetary Policy. Currently @Anahuac. PhD @Penn and masters/undergrad @ITAM_mx. From 🇲🇽

Distrito Federal, México
Joined December 2009
Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)Photo by Alberto Ramírez de Aguilar (@arawille)
Alberto Ramírez de Aguilar retweeted
I am sharing a new paper today with Dario Caldara: “Can Peer Review Survive AI-Generated Text?” sas.upenn.edu/~jesusfv/Peer_… Dario and I, as editors, are increasingly getting papers submitted to our journals that are 99 percent AI-generated. Even worse, we are also receiving many AI-generated referee reports, both as editors and, more frustratingly, as authors. And we cannot emphasize this enough: the real problem is not that the papers and reports were AI-generated; it is that no one had done the thinking behind them, and you can so easily tell. The papers were eminently forgettable, and the referee reports were disappointingly uninsightful. We have seen too many reports of the form: “The paper is well-written and addresses an important problem. However, the authors should consider additional baselines.” This deluge of AI-generated text puts peer review in jeopardy: journals will be flooded with low-quality submissions, economists will decline requests to referee papers or routinely use AI to referee them, and which papers get published will become less and less linked to their quality. We do not want to defend the status quo entirely. Peer review is slow, many reports are poor, and editors (including us!) make bad calls all the time. Still, well-executed peer review remains the best system we have for assessing each other’s work and advancing the profession. AI could improve peer review if used deliberately for that purpose, for instance, to check proofs and code. That is not what we are seeing. The difficulty is that readers, including editors and referees, cannot see how AI was used. As a result, in practice, the burden of verification shifts from the author to the reader. Since we reject this shift, Dario and I did what economists always do when something bothers us: we wrote a paper. So, what do we do in it? First, we check whether AI detectors such as Pangram get this right: is a referee report flagged as AI-generated indeed AI-generated? Or is Pangram just flagging proofreading and editing? No. We run an experiment with 25 referee reports from the pre-AI era. Proofreading and editing do not trigger AI-generated flags. Only when we ask the LLMs to substantially rewrite the referee report or to generate a new report do we get the AI-generated flags. Pretty compelling evidence, if I may say so. Second, we build a theoretical model to explore who should bear the burden of verification: the author or the reader? (Yours truly always enjoyed the courses on the rules of evidence in law school; yes, as Billy Wilder would say, nobody is perfect.) The answer is that it is much more efficient for the author to do it, because the author can verify at a much lower cost and only needs to do it once (rather than each reader repeatedly). Before AI, the authors more or less had to verify the results, even if only because they had to type them in. This was not perfect (and all papers ever published in economics probably have at least one mistake). But the problem is that, with AI, the author does not even need to read the text. Or can just skim it. Writing is thinking, and without writing there is usually not much thinking. So, a paper flagged as AI-generated is prima facie evidence that the author has not verified it. Should this lead to an automatic rejection? No. But there should be a zero-tolerance policy for serious mistakes. The first serious mistake we find in the paper, and it is out! In comparison, for a non-flagged paper, a serious mistake is something that the editor might determine it can be fixed in a revision. We are stricter with referee reports. There is absolutely no point in the referee generating a report using an LLM. As an editor, I can do that directly and save myself the trouble of asking you for it. Now, of course, you can use the LLM to help you with the report (if the journal allows it! Many journals do not allow you to upload the paper to an LLM, and you need to follow the rules). For example, you can use the LLM to search for existing results in the literature. But peer review is not about finding one sentence that is not entirely precise or a slightly sloppy mathematical proof. Referees are asked: “Is this idea important despite its flaws?” And, relatedly: “Is the paper a good fit for the journal in terms of quality and focus?” That judgment is the task for which you are selected as a subject expert. We also propose that journals require that, before a paper is submitted, the author submit it to an LLM using an approved prompt and include the LLM report and a discussion of what was and was not fixed. That way, the referee would not need to check (or at least not check so carefully) every technical detail, and they could focus on the big picture: Is this a good paper? Is this a good fit for this journal? What is fundamental for this paper to become publishable at this journal? Anyway. The paper has many other arguments, and we try to be nuanced. So, before ferociously typing the first complaint that crosses your mind, would you consider reading it? Chances are that we have already discussed your objection. We have been thinking about this for a long time. But by all means, leave good comments!
65
241
35
1,029
101,707
Alberto Ramírez de Aguilar retweeted
¿Por qué un gobierno renunciaría voluntariamente a parte de su poder? En mi nuevo artículo de #IntuiciónEconómica explico cómo delegar decisiones puede generar credibilidad y mejores resultados. ¡Los invito a leerlo! albertoramirezdeaguilar.com/…
2
3
192
Obviamente tienen que hablar de Wildwood y toda la polemica @Horacitu @Farandula021 @AlejandroBrofft @_Maniguis
230
📢 We're hiring at Universidad Anáhuac México! 6 Assistant Professor positions in Economics, Finance, Marketing, International Business, Strategy & Management, and Entrepreneurship. 📍 Mexico City 🌎 Spanish not required! Apply: career-center.aom.org/job/as…
1
15
1
54
5,806
Una buena política pública requiere algo más que buenas intenciones. En mi nuevo artículo de Intuición Económica explico cómo la escasez, los incentivos y las decisiones individuales pueden generar consecuencias inesperadas al regular los mercados. albertoramirezdeaguilar.com/…
151
Alberto Ramírez de Aguilar retweeted
¿Saben cuál es la lógica detrás del dinero? No dejen de leer a @arawille, que nos explica que el dinero no vale por el papel, ni por el metal, ni siquiera por el gobierno que lo emite: vale por la confianza compartida de que otra persona lo va a aceptar. albertoramirezdeaguilar.com/…
10
17
885
Alberto Ramírez de Aguilar retweeted
💸 ¿Y si prohibir el efectivo no fuese la solución a la evasión fiscal? Pagar digitalmente deja huella, pero los evasores también responden a incentivos. ¿Por qué una medida aparentemente tan lógica podría no funcionar como esperamos? ¡Te cuento! albertoramirezdeaguilar.com/…
1
1
188
¡Les comparto mi nuevo blog, Intuición Económica! Un blog que explora cómo la economía nos ayuda a entender el mundo que nos rodea. Ideas económicas explicadas de forma accesible, sin tecnicismos, pero sin sacrificar el rigor. ¡Espero que lo disfruten! albertoramirezdeaguilar.com/…
1
493
Alberto Ramírez de Aguilar retweeted
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
20,362
166,532
39,482
799,022
175,812,927
Alberto Ramírez de Aguilar retweeted
Martes y miércoles hay sesiones informativas de Knight-Hennessy Scholars @KnightHennessy (Stanford) en CDMX. Yo fui de la primera generación, en 2018, y el martes voy a andar en la UNAM (10:30) y el ITAM (1 pm). Va un hilo corto sobre por qué vale la pena ir:
1
4
21
1,551
Alberto Ramírez de Aguilar retweeted
Should optimal tax policy eliminate financial informality? Not necessarily. In my new paper, I show how tolerating hidden savings can deter tax evasion while preserving formal savings and public-good provision. albertoramirezdeaguilar.com/… #EconTwitter #PublicFinance
1
3
303
Should optimal tax policy eliminate financial informality? Not necessarily. In my new paper, I show how tolerating hidden savings can deter tax evasion while preserving formal savings and public-good provision. albertoramirezdeaguilar.com/… #EconTwitter #PublicFinance
1
3
303
On a professional note, I began working at @AnahuacSur, where I am an Assistant Professor. Very happy to continue my research on theoretical macroeconomics in here, and happy for this new chapter of my life!!
15
1,032
Muy contento de regresar a dar clases este verano al @ITAM_mx @EconomiaITAM_ , esta vez de Teoría y Política Monetaria.
9
458
Alberto Ramírez de Aguilar retweeted
Hopped a bus in Mexico City, destination: Street of Dreams. ‘Justice an obsession, love is a procession down the street of dreams’
326
3,258
390
13,955
648,874
Alberto Ramírez de Aguilar retweeted
Just uploaded a paper in which I study optimal taxation under unobservable income and hidden savings. Paper helps to understand how informality and evasion may arise, and studies optimal taxes in this world. Feedback welcome! albertoramirezdeaguilar.com/… #EconTwitter #Macro
1
4
1,034
Just uploaded a paper in which I study optimal taxation under unobservable income and hidden savings. Paper helps to understand how informality and evasion may arise, and studies optimal taxes in this world. Feedback welcome! albertoramirezdeaguilar.com/… #EconTwitter #Macro
1
4
1,034