Astrollama: Towards specialized foundation models in astronomy TD Nguyen, YS Ting, I Ciucă, C O'Neill, ZC Sun, M Jabłońska, S Kruk, ... arXiv preprint arXiv:2309.06126, 2023 | 12 | 2023 |
Astrollama-chat: Scaling astrollama with conversational and diverse datasets E Perkowski, R Pan, TD Nguyen, YS Ting, S Kruk, T Zhang, C O’Neill, ... Research Notes of the AAS 8 (1), 7, 2024 | 9 | 2024 |
Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Content C O'Neill, J Miller, I Ciuca, YS Ting, T Bui arXiv preprint arXiv:2308.13768, 2023 | 5 | 2023 |
Disentangling dense embeddings with sparse autoencoders C O'Neill, C Ye, K Iyer, JF Wu arXiv preprint arXiv:2408.00657, 2024 | 4 | 2024 |
Sparse Autoencoders Enable Scalable and Reliable Circuit Identification in Language Models C O'Neill, T Bui arXiv preprint arXiv:2405.12522, 2024 | 3 | 2024 |
Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity J Miller, C O'Neill, T Bui arXiv preprint arXiv:2310.17247, 2023 | 3 | 2023 |
pathfinder: A Semantic Framework for Literature Review and Knowledge Discovery in Astronomy KG Iyer, M Yunus, C O’Neill, C Ye, A Hyk, K McCormick, I Ciucă, JF Wu, ... The Astrophysical Journal Supplement Series 275 (2), 38, 2024 | 2 | 2024 |
Eigenvalue initialisation and regularisation for Koopman autoencoders JW Miller, C O'Neill, NC Constantinou, O Azencot arXiv preprint arXiv:2212.12086, 2022 | 2 | 2022 |
Steering language generation: Harnessing contrastive expert guidance and negative prompting for coherent and diverse synthetic data generation C O'Neill, YS Ting, I Ciuca, J Miller, T Bui arXiv preprint arXiv:2308.07645, 2023 | 1 | 2023 |
Compute Optimal Inference and Provable Amortisation Gap in Sparse Autoencoders C O'Neill, D Klindt arXiv preprint arXiv:2411.13117, 2024 | | 2024 |
Measuring Sharpness in Grokking J Miller, P Gleeson, C O'Neill, T Bui, N Levi arXiv preprint arXiv:2402.08946, 2024 | | 2024 |
Clinical relevance of the time course of visual improvement following real-world anti-vascular endothelial growth factor (Anti-VEGF) therapy for neovascular age-related macular … CP O'Neill, G Do, S Lindenberg, AN Karamat, G Corradetti, J Tojjar, ... Investigative Ophthalmology & Visual Science 64 (8), 2184-2184, 2023 | | 2023 |
Sparse autoencoders for dense text embeddings reveal hierarchical feature sub-structure C Ye, C O'Neill, JF Wu, KG Iyer NeurIPS 2024 Workshop on Scientific Methods for Understanding Deep Learning, 0 | | |
Towards Interpretable Scientific Foundation Models: Sparse Autoencoders for Disentangling Dense Embeddings of Scientific Concepts C O'Neill, C Ye, KG Iyer, JF Wu Neurips 2024 Workshop Foundation Models for Science: Progress, Opportunities …, 0 | | |