Public folders are not intended for use in sharing sensitive data as the objects contained within are publicly viewable. To unpublish a folder, you can press the purple hand icon.
