arXiv:2503.00374v1 Announce Type: cross
Abstract: Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease. Multi-modal self-supervised learning has demonstrated remarkable potential in learning pathological representations by integrating diverse data sources. Conventional multi-modal integration methods primarily emphasize modality alignment, while paying insufficient attention to retaining the modality-specific structures. However, unlike conventional scenarios where multi-modal inputs share highly overlapping features, histopathology and transcriptomics exhibit pronounced heterogeneity, offering orthogonal yet complementary insights. Histopathology provides morphological and spatial context, elucidating tissue architecture and cellular topology, whereas transcriptomics delineates molecular signatures through gene expression patterns. This inherent disparity introduces a major challenge in aligning them while maintaining modality-specific fidelity. To address these challenges, we present MIRROR, a novel multi-modal representation learning method designed to foster both modality alignment and retention. MIRROR employs dedicated encoders to extract comprehensive features for each modality, which is further complemented by a modality alignment module to achieve seamless integration between phenotype patterns and molecular profiles. Furthermore, a modality retention module safeguards unique attributes from each modality, while a style clustering module mitigates redundancy and enhances disease-relevant information by modeling and aligning consistent pathological signatures within a clustering space. Extensive evaluations on TCGA cohorts for cancer subtyping and survival analysis highlight MIRROR’s superior performance, demonstrating its effectiveness in constructing comprehensive oncological feature representations and benefiting the cancer diagnosis.
MULTI-MODAL SELF-SUPERVISED LEARNING IN ONCOLOGY
In the field of oncology, the combination of histopathology and transcriptomics provides valuable insights into the morphology and molecular aspects of cancer. However, integrating these diverse data sources poses a challenge due to their inherent differences in characteristics. Conventional multi-modal integration methods tend to focus on aligning the modalities, but often fail to retain modality-specific structures. This is especially crucial in the case of histopathology and transcriptomics, where their distinct features offer unique and complementary information.
MIRROR: ADDRESSING THE CHALLENGES
To overcome these challenges, the researchers propose a novel multi-modal representation learning method called MIRROR. MIRROR takes into account both modality alignment and retention, providing a comprehensive solution for learning pathological representations.
MIRROR utilizes dedicated encoders to extract comprehensive features for each modality. This allows for the preservation of the specific attributes of histopathology and transcriptomics. Furthermore, MIRROR employs a modality alignment module to seamlessly integrate phenotype patterns and molecular profiles, bridging the gap between the morphology and gene expression patterns.
To ensure the uniqueness of each modality, MIRROR incorporates a modality retention module. This module safeguards the modality-specific attributes, preventing the loss of crucial information. Additionally, a style clustering module is incorporated to mitigate redundancy and enhance disease-relevant information. By modeling and aligning consistent pathological signatures within a clustering space, MIRROR maximizes the utility of the multi-modal data.
APPLICATIONS IN CANCER DIAGNOSIS
The effectiveness of MIRROR is extensively evaluated on TCGA cohorts for cancer subtyping and survival analysis. The results demonstrate its superior performance in constructing comprehensive oncological feature representations. By effectively integrating histopathology and transcriptomics, MIRROR provides valuable insights for cancer diagnosis.
IMPACT ON MULTIMEDIA INFORMATION SYSTEMS
The development of MIRROR contributes to the wider field of multimedia information systems. By integrating multi-modal data, MIRROR enhances the analysis and understanding of complex diseases, such as cancer. Its approach of balancing modality alignment and retention can be applied to other domains where diverse data sources need to be integrated. Additionally, MIRROR highlights the importance of multi-disciplinary collaboration, as it requires expertise from both the fields of oncology and information systems.
RELEVANCE TO ANIMATIONS, ARTIFICIAL REALITY, AUGMENTED REALITY, AND VIRTUAL REALITIES
While the focus of this article is on the application of MIRROR in oncology, the concepts and techniques discussed have relevance in the fields of animations, artificial reality, augmented reality, and virtual realities.
Animations, artificial reality, augmented reality, and virtual realities often involve the integration of different data sources and modalities to create immersive and interactive experiences. Just like in the case of histopathology and transcriptomics, the challenge lies in aligning and retaining the distinct characteristics of each modality. MIRROR’s approach of dedicated encoders, modality alignment, retention modules, and style clustering can be adapted to these fields to improve the integration and representation of multi-modal data.
In conclusion, the development of MIRROR and its applications in oncology demonstrate the importance of multi-modal self-supervised learning and the need for a balanced approach to modality alignment and retention. The concepts and techniques discussed in this article have far-reaching implications in the wider field of multimedia information systems, as well as in animations, artificial reality, augmented reality, and virtual realities.
In a major exhibition at the Royal Academy, Brazil’s modernist art movement takes center stage once again. The exhibition titled “Brasil! Brasil! The Birth of Modernism” explores the period between 1910 and 1970 and features the works of 10 Brazilian artists. This exhibition aims to shed light on lesser-known artists from Brazil and raise awareness about their contributions to modernism.
Throughout this 60-year period, Brazil experienced a blossoming of the arts, with artists exploring new techniques and color palettes. The shift away from traditional art forms was an attempt to establish a new identity for the young republic, one that represented the diversity and culture of Brazil. Artists began to embrace the country’s vegetation, architecture, and faces, showcasing what it truly meant to be Brazilian.
The exhibition highlights various themes and subjects that were of importance to these modernist artists. Lasar Segall, a Jewish Lithuanian immigrant, depicted themes of oppression and displacement in Brazil through his paintings. Condido Portinari showcased the harsh lives of farmers from Brazil’s hinterlands, while Vicente do Rego Monteiro incorporated Indigenous cultural expressions into his works. Flávio de Carvalho experimented with multiple artistic movements, synthesizing European avant-garde styles from a Brazilian perspective.
One significant aspect of this exhibition is the inclusion of self-taught artists like Djanira da Motta e Silva. Their works challenge the preconceived notions of primitive or popular art and demonstrate their substantial artistic talent. These artists were not mere observers but members of the cultures they depicted, adding authenticity and depth to their works.
The exhibition concludes with artists whose work embodies pure abstraction. Alfredo Volpi’s paintings from the 1940s and onwards showcase his departure from figurative works into purely geometric patterns. Rubem Valentim’s sculptures and geometric paintings bridge Afro-Brazilian cultural traditions with modernism. Geraldo de Barros’s unconventional “Fotoformas” photographs utilize unusual medium-altering techniques.
Through “Brasil! Brasil! The Birth of Modernism,” the Royal Academy aims to compensate for its 1944 exhibition of Brazilian modernism that was subject to political coercion. By highlighting the works of lesser-known Brazilian artists, the exhibition aims to raise awareness and appreciation for their contributions to modernism. It presents Brazilian modernism as an amorphous movement, showcasing the diversity of artistic expression during that period.
Prediction and recommendation for the industry:
Based on the resurgence of interest in Brazilian modernism, it is likely that contemporary artists will draw inspiration from this period and incorporate its themes, techniques, and color palettes into their own works. The exploration of Brazilian culture and identity will continue to be an important subject for artists, especially as Brazil continues to grapple with issues of diversity and inclusivity.
To stay relevant, art institutions and galleries should consider hosting more exhibitions that highlight lesser-known artists from diverse regions. This not only provides a platform for underrepresented artists but also enriches the art scene by introducing new perspectives and styles.
Additionally, there is a need for more research and documentation of self-taught and outsider artists. These artists often challenge traditional art narratives and contribute unique perspectives to the art world. By recognizing and studying their works, art institutions can broaden the understanding of art history and provide a platform for marginalized voices.
In recent years, there has been a significant shift in several key themes that are shaping the future trends of various industries. These themes include technological advancements, changing consumer behavior, sustainability, and globalization. As businesses strive to stay ahead of the curve and adapt to these evolving trends, it is essential to analyze their potential impact and devise strategies to harness their potential.
Technological Advancements
Technology continues to revolutionize various industries, transforming the way businesses operate and engage with customers. The future trends in technology are likely to focus on areas such as artificial intelligence (AI), blockchain, Internet of Things (IoT), and virtual reality (VR).
Artificial Intelligence (AI) is expected to play a significant role in enhancing customer experiences, optimizing business processes, and driving automation. AI-powered chatbots and virtual assistants will become more sophisticated, providing personalized assistance to users. Predictive analytics and machine learning algorithms will enable businesses to make data-driven decisions and anticipate customer needs.
Blockchain technology, most notably associated with cryptocurrencies like Bitcoin, has the potential to reshape industries beyond finance. It offers secure and transparent transactions, making it ideal for supply chain management, healthcare records, and intellectual property rights. As blockchain becomes more mainstream, businesses can expect increased efficiency, reduced costs, and enhanced trust among stakeholders.
Internet of Things (IoT) devices will continue to connect and automate various aspects of consumers’ lives. Smart homes, wearable devices, and connected infrastructure will provide convenience, efficiency, and personalized experiences. However, businesses must address concerns related to data privacy and security as the IoT ecosystem expands.
Virtual Reality (VR) and Augmented Reality (AR) technologies have gained traction in gaming and entertainment industries. However, their potential applications extend beyond these sectors. In the future, VR and AR could revolutionize training programs, remote collaboration, and immersive experiences in industries such as healthcare, education, and architecture.
Changing Consumer Behavior
Consumer behavior is constantly evolving, driven by factors such as demographic shifts, social influence, and the increasing importance of sustainability.
The rise of the millennial generation, with their unique preferences and values, is shaping the future of consumer behavior. They prioritize experiences over material possessions, seek authenticity, value sustainability, and demand personalization. As millennials become the largest consumer group, businesses must adapt their strategies to cater to their needs.
The influence of social media on consumer behavior cannot be ignored. Customers rely heavily on reviews, recommendations, and influencers’ opinions before making purchasing decisions. Brands that actively engage with consumers on social media platforms and foster communities around their products or services will thrive in the future.
Sustainability is gaining prominence as consumers become more conscious of environmental issues. They expect businesses to adopt eco-friendly practices, reduce waste, and support social causes. In order to meet these expectations, companies should prioritize sustainable production methods, implement supply chain transparency, and communicate their sustainability efforts effectively.
Globalization
Globalization has transformed the business landscape, enabling companies to expand their markets beyond borders and tap into a global customer base. The future trends related to globalization will focus on cross-border collaborations, emerging markets, and cultural adaptation.
Collaborations between companies from different countries will become increasingly common as they combine expertise and resources to enter new markets. Strategic partnerships and mergers will enable businesses to overcome cultural, legal, and logistical challenges, facilitating global expansion.
Emerging markets, such as China and India, present tremendous growth opportunities. These markets boast large populations with rising disposable incomes, creating a demand for various products and services. To succeed in these markets, businesses must adapt their offerings to local tastes, preferences, and cultural norms.
Cultural adaptation is crucial for businesses operating in diverse markets. They need to understand and respect the cultural nuances of different regions to effectively engage with local customers. By employing multicultural staff, conducting market research, and customizing marketing campaigns, companies can establish a strong brand presence globally.
Conclusion
The future trends related to technological advancements, changing consumer behavior, sustainability, and globalization hold immense potential for businesses across industries. To stay ahead of the curve, companies need to embrace AI, blockchain, IoT, and VR/AR technologies. They should adapt their strategies to cater to the preferences of millennial consumers, leverage the power of social media, and prioritize sustainability. Moreover, businesses must explore opportunities in emerging markets and foster cross-border collaborations while being culturally adaptable.
By understanding and embracing these future trends, businesses can position themselves as innovators and leaders in their respective industries.
References:
Lee, J.W. et al. (2020). The impact of artificial intelligence on marketing: implications for research and practice. Journal of Business Research, 122, 539-549.
Solis, B. (2019). Lifescale: How to Live a More Creative, Productive, and Happy Life. Wiley.
Daughtery, T. and Wilson, H.J. (2019). Human + Machine: Reimagining Work in the Age of AI. Harvard Business Review Press.
De Massis, A., Frattini, F., and Lichtenthaler, U. (2013). Knowledge transfer in family firms: external influence and the role of socioemotional factors. Entrepreneurship Theory and Practice, 37(6), 1227-1253.
Duan, Y., et al. (2021). Understanding the moderating effects of social media on technological innovation. Pacific-Basin Finance Journal, 65, 101443.
ACCA. (2021). Business Sustainability: Understanding and Managing Your Environmental, Social, and Governance Risks. Retrieved from https://www.accaglobal.com/gb/en/professional-insights/global-economics/business.html
UN Environment Programme. (2017). Global E-waste Monitor 2017. Retrieved from https://www.itu.int/en/ITU-D/Environment/Documents/Reports/GEM_2017_Press_release_REV.pdf
Singh, A. (2018). Globalization and Emerging Markets: Insights from India. SAGE Publications India.
Crossman, A. and Bryer, T. (Eds.). (2020). Redefining Globalization and Economic Development: Insights from Africa. Palgrave Macmillan.
In a recent article published by WWD Weekend, several designers were asked to share their favorite museums in the world. The answers varied from iconic institutions to lesser-known gems, showcasing the diverse and inspiring nature of museums as a source of inspiration for fashion designers. The designers mentioned museums in cities such as Milan, Rome, Tokyo, New York, London, and Athens, among others, highlighting the global influence of these cultural spaces.
Giorgio Armani, one of the most renowned Italian designers, revealed his love for the Pinacoteca di Brera in Milan. This museum, located in the Palazzo di Brera, houses masterpieces by great painters such as Caravaggio and Raffaello. Armani finds inspiration in the blend of aristocratic elegance and popular charm that is characteristic of Milan.
Another designer who mentioned a museum in Milan is Maria Grazia Chiuri, creative director of Dior. She revealed her fondness for the Galleria Nazionale di Arte Moderna in Rome and the Brooklyn Museum in New York. Both museums have played a formative role in her adult life and continue to inspire her work.
Anthony Vaccarello, creative director of Saint Laurent, confessed his admiration for the Museum of Modern Art (MoMA) in New York. He mentioned that visiting museums in his own city, Paris, is less common for him, but going to MoMA allows him to become more aware of culture and exhibitions that he should see.
Rick Owens, known for his avant-garde designs, expressed his appreciation for the Tate Modern in London. He particularly likes the proportions of the rooms and the modern industrial feel of the museum. Giambattista Valli, renowned for his romantic and feminine creations, could not decide between The Calico Museum of Textiles in Ahmedabad and Palazzo Massimo, The National Roman Museum. Both museums contribute to a constant conversation in his head.
Peter Copping, the former creative director of Lanvin, mentioned the Victoria and Albert Museum (V&A) in London as his favorite. He finds inspiration in the various rooms, such as the plaster room and the British rooms, and highlights the iconic Henry VIII writing casket as a truly amazing piece.
Alexandre Mattuissi, the creative director of Ami Paris, shared his love for the Dia Beacon in New York. This museum, located two hours away from the city, offers a large and quiet space for reflection and contemplation. For each visit, Mattuissi almost feels as if he is alone in the museum, allowing him to fully immerse himself in the artwork.
Brunello Cucinelli, known for his luxurious cashmere creations, mentioned the National Museum in Athens as his favorite due to his education and affection for classic Greek culture. Similarly, Alessandro Sartori, creative director of Zegna, expressed his admiration for the Museo Nacional Centro de Arte Reina Sofia in Madrid, specifically mentioning Pablo Picasso’s “Guernica.”
Norbert Stumpfl, creative director of Brioni, revealed his love for the Palazzo Altemps in Rome. This museum, located next to Piazza Navona, showcases Roman, Greek, and Egyptian antiquities in a stylish and uncrowded setting. Stumpfl considers it a hidden gem in Rome.
Kim Jones, creative director of Dior Men and the vice president of The Charleston Trust, emphasized the significance of The Charleston Trust as a place of constant inspiration for him. He plans to donate his entire collection to the trust and build the Virginia Woolf Library there, showcasing his commitment to preserving cultural heritage and supporting artistic endeavors.
Adeju Thompson, founder of Lagos Space Programme, named the V&A as his favorite museum due to his interest in decorative arts. He also mentioned the Museum of Decorative Arts in Paris as an obsession of his, specifically because it allows him to study the craftsmanship of clothes from the 18th and 19th centuries. Thompson believes in the importance of exposing oneself to admired things and building a vocabulary from that exposure.
Jung Wook-jun, the creative director of Juun.J, shared his love for the Leeum Samsung Museum of Art in Seoul. This museum, consisting of a traditional Korean art section and a contemporary art section, captivates him with its poetic atmosphere.
These responses from top designers highlight the powerful influence of museums on the fashion industry. Designers find inspiration in the artwork, architecture, and cultural heritage that museums showcase. The diverse range of museums mentioned reflects the global nature of inspiration and creativity in the fashion industry.
Based on these trends, several potential future trends can be predicted:
1. Collaborations between fashion brands and museums: Fashion brands could partner with museums to create special collections inspired by the artwork and cultural heritage showcased in the museums. This collaboration would not only promote the museums but also provide unique and meaningful designs for fashion consumers.
2. Pop-up exhibitions in fashion stores: Fashion brands could host pop-up exhibitions featuring artwork and artifacts from museums, creating a fusion of art and fashion. This would attract a wider audience to both the fashion brands and the museums and provide an immersive experience for consumers.
3. Sustainable fashion inspired by historical textiles: Designers’ interest in decorative arts and historical textiles, as mentioned by Adeju Thompson, offers opportunities for the development of sustainable fashion. By studying craftsmanship from the past, designers can incorporate traditional techniques and materials into their creations, promoting ethical and sustainable practices in the industry.
4. Virtual reality museum experiences: As technology advances, fashion brands and museums could collaborate to create virtual reality experiences that allow consumers to explore museums and their collections from the comfort of their homes. This would make art and fashion more accessible to a global audience and further promote cultural appreciation.
In conclusion, the responses from top designers about their favorite museums showcase the important role that museums play in inspiring the fashion industry. The diverse range of museums mentioned highlights the global influence of these cultural spaces. Based on these trends, potential future trends include collaborations between fashion brands and museums, pop-up exhibitions in fashion stores, the development of sustainable fashion inspired by historical textiles, and the creation of virtual reality museum experiences.
References:
– WWD Weekend article: [https://wwd.com/fashion-news/fashion-scoops/designers-reveal-favorite-museums-1203165853/](https://wwd.com/fashion-news/fashion-scoops/designers-reveal-favorite-museums-1203165853/)
– Pinacoteca di Brera: [https://pinacotecabrera.org/it/](https://pinacotecabrera.org/it/)
– Galleria Nazionale di Arte Moderna: [https://lagallerianazionale.com/](https://lagallerianazionale.com/)
– Brooklyn Museum: [https://www.brooklynmuseum.org/](https://www.brooklynmuseum.org/)
– Museum of Modern Art (MoMA): [https://www.moma.org/](https://www.moma.org/)
– Tate Modern: [https://www.tate.org.uk/visit/tate-modern](https://www.tate.org.uk/visit/tate-modern)
– The Victoria and Albert Museum (V&A): [https://www.vam.ac.uk/](https://www.vam.ac.uk/)
– Dia:Beacon: [https://www.diaart.org/visit/visit/diabeacon-beacon](https://www.diaart.org/visit/visit/diabeacon-beacon)
– Leeum Samsung Museum of Art: [http://www.leeum.org/](http://www.leeum.org/)
– The Charleston Trust: [https://www.charleston.org.uk/](https://www.charleston.org.uk/)
– Lagos Space Programme: [https://lagosspaceprogramme.com/](https://lagosspaceprogramme.com/)
– The Museo Nacional Centro de Arte Reina Sofia: [https://www.museoreinasofia.es/en](https://www.museoreinasofia.es/en)
– Palazzo Altemps: [https://www.museiincomuneroma.it/en/museo/palazzo-altemps](https://www.museiincomuneroma.it/en/museo/palazzo-altemps)
– The National Museum in Athens: [https://www.namuseum.gr/en/](https://www.namuseum.gr/en/)
– Zegna: [https://www.zegna.com/](https://www.zegna.com/)
Exploring the Future of Space Exploration at the Houston AutoBoative Show
From January 29 to February 2, 2025, the Johnson Space Center employees brought the future of space exploration to the Houston AutoBoative Show. This unique event, which combines the auto and boat show, showcased NASA’s Artemis exhibit, introducing visitors to the technologies that will be used to explore the lunar surface.
Advancements in Lunar Surface Exploration
The Artemis exhibit featured lunar terrain vehicle mockups from Astrolab, Intuitive Machines, and Lunar Outpost. These rovers will play a critical role in allowing astronauts to explore the lunar surface, conduct scientific research, and live and work in space. NASA is set to select the rover that will fly to the Moon later this year, marking a significant milestone in lunar exploration.
In addition to the rovers, the exhibit also showcased a mockup of JAXA’s (Japan Aerospace Exploration Agency) pressurized rover, which serves as a mobile habitat for astronauts. Axiom Space’s lunar spacesuit, developed specifically for Artemis III astronauts, was also on display.
These advancements in technology will enable astronauts to further our understanding of the Moon and pave the way for future missions to Mars.
Preparing for Mars Exploration
Vanessa Wyche, Director of the Johnson Space Center, emphasized the importance of these technologies in advancing lunar exploration. Every lesson learned on the Moon will contribute to the development of strategies, technologies, and experiences necessary for sending astronauts to Mars.
By showcasing the Artemis exhibit at the AutoBoative Show, NASA aims to inspire the next generation of explorers to dream bigger and push the boundaries of space exploration. The excitement generated by this exhibit may spark an interest in future scientists and engineers who will play a crucial role in shaping humanity’s future in space.
Long-Term Human Presence on the Moon
NASA’s Artemis campaign aims to establish a sustainable presence on the Moon, working in collaboration with commercial and international partners. This partnership is crucial in ensuring the long-term success of human exploration beyond Earth. NASA is actively developing rockets, spacecraft, landing systems, spacesuits, rovers, habitats, and more to make this vision a reality.
The Orion spacecraft, designed to take astronauts further into deep space, will be launched atop NASA’s Space Launch System (SLS) rocket. It will transport the crew to the Moon for Artemis missions and safely return them to Earth. Lunar terrain vehicles have been developed to transport astronauts across the rugged lunar surface or be remotely operated. These vehicles have been tested at the Johnson Space Center, simulating critical maneuvers, tasks, and emergency drills.
Johnson Space Center employees at the exhibit provided interactive experiences for guests, allowing them to step into the role of an astronaut. Visitors had the opportunity to test their skills driving a lunar rover simulator, experience a simulated Orion docking, and learn about NASA’s upcoming missions and goals.
Attendees at the AutoBoative Show also had the chance to discover how American companies are contributing to science and technology on the Moon through NASA’s Commercial Lunar Payload Services initiative. This initiative aims to deliver payloads to the lunar surface, facilitating research and exploration.
The Artemis exhibit at the Houston AutoBoative Show showcased the future of space exploration and highlighted the advancements being made in lunar exploration. With the goal of establishing a sustained presence on the Moon and eventually sending humans to Mars, NASA’s Artemis campaign represents a significant leap forward in the field of space exploration.
