Computer Network Security and Technology Research
Ieee account.
- Change Username/Password
- Update Address
Purchase Details
- Payment Options
- Order History
- View Purchased Documents
Profile Information
- Communications Preferences
- Profession and Education
- Technical Interests
- US & Canada: +1 800 678 4333
- Worldwide: +1 732 981 0060
- Contact & Support
- About IEEE Xplore
- Accessibility
- Terms of Use
- Nondiscrimination Policy
- Privacy & Opting Out of Cookies
A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. © Copyright 2024 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.
Academia.edu no longer supports Internet Explorer.
To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to upgrade your browser .
- We're Hiring!
- Help Center
Computer Networks
- Most Cited Papers
- Most Downloaded Papers
- Newest Papers
- Save to Library
- Last »
- Science and Technology Studies Follow Following
- Software Follow Following
- Databases Follow Following
- Science, Technology and Society Follow Following
- Sociology of Science Follow Following
- STS (Anthropology) Follow Following
- Actor Network Theory Follow Following
- Social Studies Of Science Follow Following
- History of Science Follow Following
- History of Science and Technology Follow Following
Enter the email address you signed up with and we'll email you a reset link.
- Academia.edu Publishing
- We're Hiring!
- Help Center
- Find new research papers in:
- Health Sciences
- Earth Sciences
- Cognitive Science
- Mathematics
- Computer Science
- Academia ©2024
Help | Advanced Search
Computer Science > Computer Vision and Pattern Recognition
Title: ferret-ui: grounded mobile ui understanding with multimodal llms.
Abstract: Recent advancements in multimodal large language models (MLLMs) have been noteworthy, yet, these general-domain MLLMs often fall short in their ability to comprehend and interact effectively with user interface (UI) screens. In this paper, we present Ferret-UI, a new MLLM tailored for enhanced understanding of mobile UI screens, equipped with referring, grounding, and reasoning capabilities. Given that UI screens typically exhibit a more elongated aspect ratio and contain smaller objects of interest (e.g., icons, texts) than natural images, we incorporate "any resolution" on top of Ferret to magnify details and leverage enhanced visual features. Specifically, each screen is divided into 2 sub-images based on the original aspect ratio (i.e., horizontal division for portrait screens and vertical division for landscape screens). Both sub-images are encoded separately before being sent to LLMs. We meticulously gather training samples from an extensive range of elementary UI tasks, such as icon recognition, find text, and widget listing. These samples are formatted for instruction-following with region annotations to facilitate precise referring and grounding. To augment the model's reasoning ability, we further compile a dataset for advanced tasks, including detailed description, perception/interaction conversations, and function inference. After training on the curated datasets, Ferret-UI exhibits outstanding comprehension of UI screens and the capability to execute open-ended instructions. For model evaluation, we establish a comprehensive benchmark encompassing all the aforementioned tasks. Ferret-UI excels not only beyond most open-source UI MLLMs, but also surpasses GPT-4V on all the elementary UI tasks.
Submission history
Access paper:.
- Other Formats
References & Citations
- Google Scholar
- Semantic Scholar
BibTeX formatted citation
Bibliographic and Citation Tools
Code, data and media associated with this article, recommenders and search tools.
- Institution
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .
IMAGES
VIDEO
COMMENTS
Computer networks are a. system of i nterconnected computers for the purpose of. sharing digital information. The computer network. enables to analyze, organize and disseminate the. information ...
The International Journal of Computer and Telecommunications Networking Computer Networks is an international, archival journal providing a publication vehicle for complete coverage of all topics of interest to those involved in the computer communications networking area. The audience includes researchers, managers and operators of networks as well as designers and implementors.
Computing. Cloud Computing offers virtualized computing, storage, and networking resources, over the Internet, to organizations and individual users in a completely dynamic way. These cloud resources are cheaper, easier to manage, and more elastic than sets of local, physical, ones. This encourages customers to outsource their applications and ...
Steady State Analysis of Base Station Buffer Occupancy in a Cellular Mobile System. Fayza A. Nada. 23 Mar 2023. PDF. Citation. Journal of Computer Networks and Communications -. Volume 2023. - Article ID 8571506. - Research Article.
Threats from the Dark: A Review over Dark Web Investigation Research for Cyber Threat Intelligence. Randa Basheer | Bassel Alkhatib. 20 Dec 2021. PDF. Citation. Journal of Computer Networks and Communications -. Volume 2021. - Article ID 4124230. - Research Article.
Download PDF Abstract: Our modern society and competitive economy depend on a strong digital foundation and, in turn, on sustained research and innovation in computer systems and networks (CompSys). With this manifesto, we draw attention to CompSys as a vital part of ICT. Among ICT technologies, CompSys covers all the hardware and all the operational software layers that enable applications ...
Journal of Computer Networks and Communications publishes original research and review articles that investigate both the theoretical and practical aspects of computer networks and communications. ... The approach of this research is to use the spiking neural network (SNN) with a group of sparks to detect money laundering, but due to the ...
A computer system including related peripherals, integrated as part of a network of one form or another, is becoming more and more a standard configuration being implemented by system designers today. Made possible through advances in communication technology and network concepts, these new configurations of telecommunications networks vary from simple arrangements of a minicomputer plus a few ...
significant challenges to networks is attacks on their resources caused by inadequate network security. In this research paper we highlight and overview concept of computer networks. Computer networks have become increasingly ubiquitous. In today's world, a computer network is much more than a collection of interconnected devices.
The rapid development of computer network system brings both a great convenience and new security threats for users. Network security problem generally includes network system security and data security. Specifically, it refers to the reliability of network system, confidentiality, integrity and availability of data information in the system. Network security problem exists through all the ...
This paper discusses the possible exploits on typical network components, it will cite real life scenarios, and propose practical measures that can be taken as safeguard. Then, it describes some of the key efforts done by the research community to prevent such attacks, mainly by using Firewall and Intrusion Detection Systems. 2.
Answering Three Questions About Networking Research. Jennifer Rexford. Princeton University [email protected]. Scott Shenker. UC Berkeley and ICSI [email protected]. This article is an editorial note submitted to CCR. It has NOT been peer reviewed. The authors take full responsibility for this article's technical content.
In this research paper we highlight and overview concept of computer networks. Computer networks have become increasingly ubiquitous. In today's world, a computer network is much more than a collection of interconnected devices. Computer networks are a system of interconnected computers for the purpose of sharing digital information.
A network interface device or network interface card (NIC)on every computer A switch is used to switch the data from one point to another. Hubs are obsolete. Network operating system software III. TYPES OF NETWORKS The network can be divided into geographical regions and fall into these broad categories [5].
What DNS Is Not - Paper Summary by Koray Özgürbüz. This paper is a summary of "What DNS Is Not", a paper written by Paul Vixie, who is an American computer scientist and internet hall of fame. His technical contributions include Domain Name System (DNS) protocol design and procedure,... more. Download.
etc. (CS144: "An Introduction to Computer Networks"), and a graduate class where students interested in careers in networking as engineers or researchers read and discuss 20-30 "classic" research papers (CS244: "Advanced Topics in Networking"). Networking classes covering similar topics are prevalent at many universities around the ...
- Classic research papers "Underlay" Networks (8 classes) - The infrastructure underlying the modern Internets - Wireless & datacenter networks, optical networks, software-defined networks, programmable routers "Overlay" Networks (5 classes) - Applications that run on top of the Internet
computer networks has increased significantly. One of the most significant challenges to networks is attacks on their resources caused by inadequate network security. In this research paper we highlight and overview concept of computer networks. Keywords: Computer networks, protocols, network security. I. INTRODUCTION
ReALM: Reference Resolution As Language Modeling. Reference resolution is an important problem, one that is essential to understand and successfully handle context of different kinds. This context includes both previous turns and context that pertains to non-conversational entities, such as entities on the user's screen or those running in the ...
View PDF Abstract: Recent advancements in multimodal large language models (MLLMs) have been noteworthy, yet, these general-domain MLLMs often fall short in their ability to comprehend and interact effectively with user interface (UI) screens. In this paper, we present Ferret-UI, a new MLLM tailored for enhanced understanding of mobile UI screens, equipped with referring, grounding, and ...