Jun 06 13:45:37.207414 ip-10-0-139-222 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 06 13:45:37.207423 ip-10-0-139-222 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 06 13:45:37.207430 ip-10-0-139-222 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 06 13:45:37.207581 ip-10-0-139-222 systemd[1]: Failed to start Kubernetes Kubelet. Jun 06 13:45:48.611801 ip-10-0-139-222 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 06 13:45:48.611823 ip-10-0-139-222 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 05ffb58ac9ca4c01abffa103ba938dca -- Jun 06 13:48:23.543413 ip-10-0-139-222 systemd[1]: Starting Kubernetes Kubelet... Jun 06 13:48:23.976915 ip-10-0-139-222 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:48:23.976915 ip-10-0-139-222 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 13:48:23.976915 ip-10-0-139-222 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:48:23.976915 ip-10-0-139-222 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 13:48:23.976915 ip-10-0-139-222 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:48:23.977784 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.977702 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 13:48:23.982776 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982758 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:48:23.982776 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982775 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982779 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982782 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982785 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982788 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982791 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982794 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982797 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982800 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982802 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982805 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982808 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982811 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982814 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982817 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982819 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982822 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982824 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982827 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982830 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:48:23.982854 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982832 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982835 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982837 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982840 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982842 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982845 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982847 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982852 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982854 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982857 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982862 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982866 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982869 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982873 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982875 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982878 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982881 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982884 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982887 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:48:23.983432 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982889 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982891 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982894 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982896 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982899 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982901 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982904 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982906 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982909 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982911 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982914 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982916 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982919 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982921 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982924 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982928 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982930 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982933 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982936 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982939 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:48:23.983896 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982943 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982947 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982950 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982953 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982957 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982960 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982963 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982966 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982968 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982971 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982974 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982976 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982979 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982981 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982984 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982987 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982989 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982992 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982995 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:48:23.984395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.982997 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983000 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983003 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983006 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983008 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983011 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983013 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983016 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983034 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983039 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983043 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983048 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983052 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983055 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983057 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983060 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983063 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983066 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983068 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983071 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:48:23.984887 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983789 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983795 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983798 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983801 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983803 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983806 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983809 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983812 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983814 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983817 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983819 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983822 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983825 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983827 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983829 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983832 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983834 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983839 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983842 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:48:23.985401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983844 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983848 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983853 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983856 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983860 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983863 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983866 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983869 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983872 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983875 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983877 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983880 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983882 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983885 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983887 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983890 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983892 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983895 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983898 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983901 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:48:23.985873 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983904 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983907 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983910 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983913 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983916 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983919 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983921 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983923 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983926 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983928 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983931 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983934 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983936 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983939 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983942 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983944 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983947 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983950 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983953 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983956 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:48:23.986401 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983958 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983961 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983964 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983966 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983969 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983973 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983976 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983979 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983982 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983985 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983988 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983991 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983995 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.983997 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984000 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984003 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984005 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984008 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984011 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:48:23.986891 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984014 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984016 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984033 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984036 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984038 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984041 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984044 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984047 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984049 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984052 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984055 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984057 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984060 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984063 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984065 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984068 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984071 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984073 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984076 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984078 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:48:23.987372 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984081 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984460 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984464 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984467 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984470 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984473 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984477 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984480 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984483 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984486 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984488 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984491 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984494 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984497 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984499 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984502 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984504 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984507 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984509 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984512 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:48:23.987879 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984515 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984517 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984520 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984522 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984525 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984527 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984530 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984532 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984535 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984537 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984540 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984542 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984545 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984547 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984551 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984554 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984556 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984559 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984564 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984568 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:48:23.988377 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984571 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984574 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984576 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984579 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984582 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984585 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984587 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984590 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984593 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984596 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984600 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984604 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984607 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984610 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984613 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984615 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984618 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984621 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984624 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:48:23.988901 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984626 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984629 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984631 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984634 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984636 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984639 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984641 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984644 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984647 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984649 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984652 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984654 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984658 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984661 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984663 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984666 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984669 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984671 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984674 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984676 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:48:23.989395 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984679 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984682 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984684 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984687 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984689 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984692 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984694 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984697 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984699 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984702 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984705 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984707 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984710 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984712 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984715 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984718 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984720 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984723 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984727 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984730 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.984732 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:48:23.989884 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984807 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984813 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984820 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984824 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984831 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984836 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984842 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984852 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984857 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984860 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984864 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984867 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984870 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984873 2578 flags.go:64] FLAG: --cgroup-root="" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984876 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984879 2578 flags.go:64] FLAG: --client-ca-file="" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984882 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984885 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984891 2578 flags.go:64] FLAG: --cluster-domain="" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984894 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984897 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984900 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984904 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984908 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 13:48:23.990453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984911 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984914 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984917 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984920 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984923 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984927 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984930 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984933 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984937 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984940 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984943 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984946 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984949 2578 flags.go:64] FLAG: --enable-server="true" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984953 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984957 2578 flags.go:64] FLAG: --event-burst="100" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984963 2578 flags.go:64] FLAG: --event-qps="50" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984965 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984968 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984971 2578 flags.go:64] FLAG: --eviction-hard="" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984975 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984978 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984981 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984984 2578 flags.go:64] FLAG: --eviction-soft="" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984987 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984990 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 13:48:23.991066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984993 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984996 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.984998 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985001 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985004 2578 flags.go:64] FLAG: --feature-gates="" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985008 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985011 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985015 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985018 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985034 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985038 2578 flags.go:64] FLAG: --help="false" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985040 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-139-222.ec2.internal" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985044 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985047 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985050 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985053 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985057 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985060 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985063 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985066 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985069 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985079 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985084 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985087 2578 flags.go:64] FLAG: --kube-reserved="" Jun 06 13:48:23.991737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985090 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985092 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985095 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985098 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985101 2578 flags.go:64] FLAG: --lock-file="" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985104 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985107 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985110 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985116 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985119 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985122 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985124 2578 flags.go:64] FLAG: --logging-format="text" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985127 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985130 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985133 2578 flags.go:64] FLAG: --manifest-url="" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985136 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985140 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985144 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985148 2578 flags.go:64] FLAG: --max-pods="110" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985151 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985154 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985157 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985160 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985163 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985166 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 13:48:23.992381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985169 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985186 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985189 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985192 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985195 2578 flags.go:64] FLAG: --pod-cidr="" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985205 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985211 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985214 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985217 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985220 2578 flags.go:64] FLAG: --port="10250" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985223 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985225 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03dbe9f0feb29c1b4" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985229 2578 flags.go:64] FLAG: --qos-reserved="" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985232 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985235 2578 flags.go:64] FLAG: --register-node="true" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985238 2578 flags.go:64] FLAG: --register-with-taints="" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985241 2578 flags.go:64] FLAG: --registry-burst="10" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985244 2578 flags.go:64] FLAG: --registry-qps="5" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985247 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985250 2578 flags.go:64] FLAG: --reserved-memory="" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985254 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985257 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985260 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985263 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985265 2578 flags.go:64] FLAG: --runonce="false" Jun 06 13:48:23.992983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985269 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985272 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985275 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985278 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985281 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985284 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985286 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985289 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985292 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985295 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985298 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985301 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985304 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985313 2578 flags.go:64] FLAG: --system-cgroups="" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985317 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985322 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985325 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985328 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985332 2578 flags.go:64] FLAG: --tls-min-version="" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985335 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985338 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985341 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985343 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985346 2578 flags.go:64] FLAG: --v="2" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985350 2578 flags.go:64] FLAG: --version="false" Jun 06 13:48:23.993621 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985354 2578 flags.go:64] FLAG: --vmodule="" Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985358 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.985361 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985477 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985480 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985483 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985486 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985488 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985491 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985495 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985498 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985500 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985503 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985505 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985507 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985510 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985513 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985515 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985518 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985520 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:48:23.994247 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985523 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985527 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985530 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985533 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985535 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985537 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985540 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985544 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985548 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985551 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985554 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985556 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985559 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985561 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985565 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985569 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985572 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985575 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985578 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:48:23.994763 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985581 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985584 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985588 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985590 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985593 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985595 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985598 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985601 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985603 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985606 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985610 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985613 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985616 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985619 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985622 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985625 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985628 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985630 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985633 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:48:23.995261 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985635 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985638 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985640 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985643 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985645 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985648 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985650 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985653 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985656 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985658 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985661 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985663 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985666 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985668 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985671 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985675 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985678 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985681 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985683 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985685 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:48:23.995728 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985688 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985690 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985693 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985696 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985698 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985701 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985703 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985706 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985708 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985711 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985714 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985717 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985719 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985722 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985724 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985727 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985729 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985731 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985734 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985736 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:48:23.996310 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985738 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985741 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985744 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.985746 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.986645 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.993526 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.993542 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.993563 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.993569 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993627 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993631 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993635 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993638 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993642 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:48:23.996804 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993645 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993649 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993654 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993657 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993661 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993665 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993668 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993671 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993675 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993678 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993681 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993683 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993686 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993689 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993692 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993694 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993697 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993700 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:48:23.997197 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993704 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993707 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993711 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993713 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993716 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993719 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993723 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993726 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993729 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993731 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993734 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993737 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993739 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993742 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993745 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993747 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993750 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993752 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993755 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993757 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:48:23.997679 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993760 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993762 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993764 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993767 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993770 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993773 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993775 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993778 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993780 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993784 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993786 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993789 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993792 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993794 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993797 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993799 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993802 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993805 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993808 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993812 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:48:23.998207 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993814 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993817 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993820 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993822 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993825 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993827 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993830 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993832 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993835 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993837 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993840 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993842 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993845 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993847 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993850 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993852 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993855 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993858 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993860 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993863 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:48:23.998781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993865 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993868 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993870 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993873 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993875 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993878 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993880 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993883 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993885 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993888 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993891 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993894 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993897 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993900 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993902 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:48:23.999373 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.993905 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.993910 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994063 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994069 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994073 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994076 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994079 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994082 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994085 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994088 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994090 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994092 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994095 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994098 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994100 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:48:23.999995 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994103 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994105 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994108 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994110 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994113 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994115 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994118 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994121 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994123 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994126 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994128 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994131 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994134 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994136 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994140 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994144 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994147 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994150 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994152 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994155 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:48:24.000584 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994157 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994160 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994163 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994165 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994168 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994170 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994173 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994175 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994178 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994180 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994183 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994185 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994188 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994191 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994193 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994196 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994198 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994200 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994203 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994206 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:48:24.001165 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994208 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994211 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994213 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994216 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994218 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994221 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994225 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994228 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994231 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994234 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994236 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994239 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994243 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994246 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994249 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994252 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994255 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994258 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994260 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:48:24.001905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994263 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994266 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994268 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994271 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994273 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994276 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994278 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994281 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994283 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994286 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994288 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994294 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994296 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994299 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994301 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994304 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994306 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994309 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994312 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994314 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:48:24.002667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994317 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994320 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994333 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994336 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994339 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994342 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:23.994344 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.994349 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.994470 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.996571 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.998048 2578 server.go:1019] "Starting client certificate rotation" Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.998165 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:23.998208 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 13:48:24.003300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.000445 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 13:48:24.004836 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.004812 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 13:48:24.016242 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.016225 2578 log.go:25] "Validated CRI v1 runtime API" Jun 06 13:48:24.018961 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.018946 2578 log.go:25] "Validated CRI v1 image API" Jun 06 13:48:24.019801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.019786 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 13:48:24.022218 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.022195 2578 fs.go:135] Filesystem UUIDs: map[26c57392-d01d-4ead-9bf0-dc8084fb3fa9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9d5f045b-66b5-4f45-ade9-67ac11ad9682:/dev/nvme0n1p3] Jun 06 13:48:24.022273 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.022219 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 13:48:24.027471 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.027367 2578 manager.go:216] Machine: {Timestamp:2026-06-06 13:48:24.026121199 +0000 UTC m=+0.354660857 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113248 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28d8f082ccd21c9ef981cd871826d2 SystemUUID:ec28d8f0-82cc-d21c-9ef9-81cd871826d2 BootID:05ffb58a-c9ca-4c01-abff-a103ba938dca Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:34:0d:d3:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:34:0d:d3:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:6f:f7:c5:d0:26 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 13:48:24.027471 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.027471 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 13:48:24.027595 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.027584 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 13:48:24.027734 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.027718 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 13:48:24.030609 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.030583 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 13:48:24.030747 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.030614 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 13:48:24.031889 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.031879 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 13:48:24.031926 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.031891 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 13:48:24.031926 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.031899 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 13:48:24.032492 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.032483 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 13:48:24.033546 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.033536 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 13:48:24.036499 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.036487 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 06 13:48:24.036618 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.036609 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 13:48:24.036658 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.036642 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 06 13:48:24.036696 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.036665 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 13:48:24.036696 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.036690 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 13:48:24.036812 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.036705 2578 kubelet.go:398] "Adding apiserver pod source" Jun 06 13:48:24.036812 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.036729 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 13:48:24.037259 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.037246 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 13:48:24.037308 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.037274 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 13:48:24.039529 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.039512 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 13:48:24.040988 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.040966 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 13:48:24.041046 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.041006 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 13:48:24.042077 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042066 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 13:48:24.042117 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042082 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 13:48:24.042117 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042089 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 13:48:24.042117 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042096 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 13:48:24.042117 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042107 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 13:48:24.042117 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042112 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 13:48:24.042253 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042120 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 13:48:24.042253 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042126 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 13:48:24.042253 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042132 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 13:48:24.042253 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042137 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 13:48:24.042253 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042151 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 13:48:24.042253 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042156 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 13:48:24.042888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042878 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 13:48:24.042888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.042888 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 13:48:24.046412 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.046397 2578 server.go:1268] "Started kubelet" Jun 06 13:48:24.046564 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.046533 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 13:48:24.046683 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.046561 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 13:48:24.046683 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.046661 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 13:48:24.046789 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.046678 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 13:48:24.046789 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.046753 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 13:48:24.046912 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.046866 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 13:48:24.047520 ip-10-0-139-222 systemd[1]: Started Kubernetes Kubelet. Jun 06 13:48:24.052856 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.052488 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 06 13:48:24.053265 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.053249 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 13:48:24.054093 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.054074 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cxwfd" Jun 06 13:48:24.056911 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.056890 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 13:48:24.057391 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.056460 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-222.ec2.internal.18b6820f1a25108e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-222.ec2.internal,UID:ip-10-0-139-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-222.ec2.internal,},FirstTimestamp:2026-06-06 13:48:24.046366862 +0000 UTC m=+0.374906521,LastTimestamp:2026-06-06 13:48:24.046366862 +0000 UTC m=+0.374906521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-222.ec2.internal,}" Jun 06 13:48:24.057594 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.057576 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 13:48:24.057594 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.057580 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 13:48:24.057739 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.057666 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.058288 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058191 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 13:48:24.058288 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058281 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 13:48:24.058288 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058291 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 13:48:24.058480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058411 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 06 13:48:24.058480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058420 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 06 13:48:24.058667 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058646 2578 factory.go:55] Registering systemd factory Jun 06 13:48:24.058667 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058668 2578 factory.go:223] Registration of the systemd container factory successfully Jun 06 13:48:24.058868 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058852 2578 factory.go:153] Registering CRI-O factory Jun 06 13:48:24.058868 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058869 2578 factory.go:223] Registration of the crio container factory successfully Jun 06 13:48:24.058970 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058957 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 13:48:24.059041 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.058985 2578 factory.go:103] Registering Raw factory Jun 06 13:48:24.059041 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.059000 2578 manager.go:1196] Started watching for new ooms in manager Jun 06 13:48:24.059378 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.059363 2578 manager.go:349] Starting recovery of all containers Jun 06 13:48:24.060931 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.060912 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cxwfd" Jun 06 13:48:24.066321 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.066268 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 13:48:24.066483 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.066422 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 06 13:48:24.066565 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.066547 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 06 13:48:24.068762 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.068746 2578 manager.go:354] Recovery completed Jun 06 13:48:24.073453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.073439 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:48:24.075967 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.075953 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:48:24.076055 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.075982 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:48:24.076055 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.075996 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:48:24.076535 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.076522 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 13:48:24.076535 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.076533 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 13:48:24.076636 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.076543 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:48:24.076636 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.076548 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 06 13:48:24.077342 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.077326 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:48:24.077391 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.077356 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:48:24.077391 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.077366 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:48:24.077738 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.077722 2578 policy_none.go:49] "None policy: Start" Jun 06 13:48:24.077738 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.077741 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 13:48:24.077851 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.077751 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 13:48:24.078793 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.078783 2578 policy_none.go:47] "Start" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.123380 2578 manager.go:337] "Starting Device Plugin manager" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.123413 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.123428 2578 server.go:87] "Starting device plugin registration server" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.123682 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.123694 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.123781 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.123882 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.123894 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.124431 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.124476 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.131627 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.131661 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.131678 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 13:48:24.132960 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.131707 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 13:48:24.133716 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.133699 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:48:24.224627 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.224580 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:48:24.225629 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.225609 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:48:24.225744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.225646 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:48:24.225744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.225660 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:48:24.225744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.225694 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.231809 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.231762 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal"] Jun 06 13:48:24.231886 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.231823 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:48:24.233396 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.233380 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.233478 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.233406 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-222.ec2.internal\": node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.233676 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.233661 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:48:24.233729 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.233684 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:48:24.233729 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.233696 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:48:24.235146 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235133 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:48:24.235252 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.235291 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235275 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:48:24.235792 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235774 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:48:24.235906 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235798 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:48:24.235906 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235814 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:48:24.235906 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235833 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:48:24.235906 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235852 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:48:24.235906 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.235861 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:48:24.237189 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.237176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.237241 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.237202 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:48:24.238860 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.238844 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:48:24.238957 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.238872 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:48:24.238957 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.238885 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:48:24.248080 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.248065 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.259643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.259621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2d242d7fadb7e7995ee7515441554c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal\" (UID: \"4d2d242d7fadb7e7995ee7515441554c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.259769 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.259650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2f79e97766e8282ec015d0786dde0e4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-222.ec2.internal\" (UID: \"b2f79e97766e8282ec015d0786dde0e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.259769 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.259677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d2d242d7fadb7e7995ee7515441554c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal\" (UID: \"4d2d242d7fadb7e7995ee7515441554c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.259769 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.259737 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-222.ec2.internal\" not found" node="ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.264326 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.264313 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-222.ec2.internal\" not found" node="ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.348463 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.348435 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.360075 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.360051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d2d242d7fadb7e7995ee7515441554c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal\" (UID: \"4d2d242d7fadb7e7995ee7515441554c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.360153 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.360081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2d242d7fadb7e7995ee7515441554c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal\" (UID: \"4d2d242d7fadb7e7995ee7515441554c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.360153 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.360102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2f79e97766e8282ec015d0786dde0e4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-222.ec2.internal\" (UID: \"b2f79e97766e8282ec015d0786dde0e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.360153 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.360144 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2f79e97766e8282ec015d0786dde0e4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-222.ec2.internal\" (UID: \"b2f79e97766e8282ec015d0786dde0e4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.360261 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.360153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d2d242d7fadb7e7995ee7515441554c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal\" (UID: \"4d2d242d7fadb7e7995ee7515441554c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.360261 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.360158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2d242d7fadb7e7995ee7515441554c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal\" (UID: \"4d2d242d7fadb7e7995ee7515441554c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.449103 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.449056 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.549817 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.549737 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.564179 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.564154 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.568847 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.568832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" Jun 06 13:48:24.650747 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.650707 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.751225 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.751194 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.851740 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.851658 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.952298 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:24.952262 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:24.997733 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.997707 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 13:48:24.998371 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:24.997855 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 13:48:25.053243 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:25.053219 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:25.061080 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:25.061052 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f79e97766e8282ec015d0786dde0e4.slice/crio-c1a52077037a3d388066f49b32da410a582e1751a94b1e39423a281f92ab455f WatchSource:0}: Error finding container c1a52077037a3d388066f49b32da410a582e1751a94b1e39423a281f92ab455f: Status 404 returned error can't find the container with id c1a52077037a3d388066f49b32da410a582e1751a94b1e39423a281f92ab455f Jun 06 13:48:25.061501 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:25.061480 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2d242d7fadb7e7995ee7515441554c.slice/crio-ab1e09f65a83caaba18a3a03c305d258489b8c0fe76706263c092df508c63c81 WatchSource:0}: Error finding container ab1e09f65a83caaba18a3a03c305d258489b8c0fe76706263c092df508c63c81: Status 404 returned error can't find the container with id ab1e09f65a83caaba18a3a03c305d258489b8c0fe76706263c092df508c63c81 Jun 06 13:48:25.063500 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.063455 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 13:43:24 +0000 UTC" deadline="2027-11-11 11:43:23.038481019 +0000 UTC" Jun 06 13:48:25.063500 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.063490 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12549h54m57.97499538s" Jun 06 13:48:25.065347 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.065325 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:48:25.120688 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.120665 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:48:25.134683 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.134643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" event={"ID":"4d2d242d7fadb7e7995ee7515441554c","Type":"ContainerStarted","Data":"ab1e09f65a83caaba18a3a03c305d258489b8c0fe76706263c092df508c63c81"} Jun 06 13:48:25.135644 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.135622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" event={"ID":"b2f79e97766e8282ec015d0786dde0e4","Type":"ContainerStarted","Data":"c1a52077037a3d388066f49b32da410a582e1751a94b1e39423a281f92ab455f"} Jun 06 13:48:25.153777 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:25.153747 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:25.254298 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:25.254258 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:25.354765 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:25.354733 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:25.455314 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:25.455229 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-222.ec2.internal\" not found" Jun 06 13:48:25.503142 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.503110 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:48:25.549632 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.549498 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:48:25.558252 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.558005 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" Jun 06 13:48:25.568474 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.568341 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 13:48:25.569465 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.569444 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" Jun 06 13:48:25.577068 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:25.577047 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 13:48:26.037150 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.037063 2578 apiserver.go:52] "Watching apiserver" Jun 06 13:48:26.047298 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.047273 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 13:48:26.048371 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.048341 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-vvtkr","openshift-multus/multus-additional-cni-plugins-nmmsg","openshift-network-diagnostics/network-check-target-cjwh8","openshift-ovn-kubernetes/ovnkube-node-wdgxr","kube-system/global-pull-secret-syncer-h9f4q","kube-system/konnectivity-agent-v65zt","openshift-image-registry/node-ca-rswsp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal","openshift-multus/multus-ghjj2","openshift-multus/network-metrics-daemon-sbklr","openshift-network-operator/iptables-alerter-hccgx","kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm","openshift-cluster-node-tuning-operator/tuned-mxfvn"] Jun 06 13:48:26.050308 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.050281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.051709 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.051683 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.053006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.052728 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 13:48:26.053006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.052828 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 13:48:26.053006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.052961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 13:48:26.053006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.052976 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:26.053006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.053003 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2xdmm\"" Jun 06 13:48:26.053304 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.053053 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:26.053832 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.053668 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 13:48:26.053832 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.053715 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wg7z2\"" Jun 06 13:48:26.054123 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.054105 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 13:48:26.054180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.054129 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 13:48:26.054548 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.054524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.055796 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.055779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.055895 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.055849 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:26.056394 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.056380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9hhv\"" Jun 06 13:48:26.056725 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.056701 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 13:48:26.057054 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.057040 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.057527 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.057507 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 13:48:26.057623 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.057551 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 13:48:26.057623 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.057565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 13:48:26.057623 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.057578 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 13:48:26.057908 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.057887 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 13:48:26.058761 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.058580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.058761 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.058601 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 13:48:26.059414 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.059395 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 13:48:26.059494 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.059470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 13:48:26.059494 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.059478 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lvnbk\"" Jun 06 13:48:26.060337 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.060321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.060520 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.060504 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 13:48:26.060948 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.060922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 13:48:26.061099 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.061083 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 13:48:26.061312 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.061291 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kv65q\"" Jun 06 13:48:26.061393 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.061291 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 13:48:26.061641 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.061623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.062188 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.062170 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 13:48:26.062391 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.062372 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t4gkw\"" Jun 06 13:48:26.062531 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.062517 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 13:48:26.063110 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.063094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:26.063199 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.063160 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:26.063700 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.063679 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 13:48:26.063914 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.063879 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-djm8k\"" Jun 06 13:48:26.064313 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.064280 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 13:48:26.064767 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.064516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.066146 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.066126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.066694 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.066679 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 13:48:26.066778 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.066704 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 13:48:26.067009 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.066991 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:48:26.067151 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.067135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j4v2z\"" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.067935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-etc-kubernetes\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.067969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-env-overrides\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.067994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bzdv\" (UniqueName: \"kubernetes.io/projected/506fa8b1-e0db-4ee7-8b14-650330c41a4e-kube-api-access-8bzdv\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-cni-bin\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-multus-certs\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kftgz\" (UniqueName: \"kubernetes.io/projected/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-kube-api-access-kftgz\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-slash\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-node-log\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-log-socket\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068270 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-system-cni-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-os-release\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-cni-binary-copy\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-netns\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mvc2r\"" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068487 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-systemd-units\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-ovn\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-cni-bin\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb03a033-6909-4c2b-a70c-0e634874820f-konnectivity-ca\") pod \"konnectivity-agent-v65zt\" (UID: \"bb03a033-6909-4c2b-a70c-0e634874820f\") " pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-cni-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.068730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-cni-multus\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovn-node-metrics-cert\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e54b170-c19f-43b1-b4ee-dc50595328ee-serviceca\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9ctd\" (UniqueName: \"kubernetes.io/projected/8e54b170-c19f-43b1-b4ee-dc50595328ee-kube-api-access-c9ctd\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-kubelet\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-systemd\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1007746-5164-438c-ad0e-eb5d1ab2d351-kubelet-config\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb03a033-6909-4c2b-a70c-0e634874820f-agent-certs\") pod \"konnectivity-agent-v65zt\" (UID: \"bb03a033-6909-4c2b-a70c-0e634874820f\") " pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.068999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-socket-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-device-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-kubelet\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-run-netns\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-etc-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovnkube-script-lib\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e54b170-c19f-43b1-b4ee-dc50595328ee-host\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.069377 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-cnibin\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-registration-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-sys-fs\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-var-lib-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1007746-5164-438c-ad0e-eb5d1ab2d351-dbus\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-hostroot\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-daemon-config\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-etc-selinux\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jc5s\" (UniqueName: \"kubernetes.io/projected/1215068a-20db-444e-a5ca-2641a62d8b94-kube-api-access-9jc5s\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-cni-netd\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovnkube-config\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-socket-dir-parent\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-k8s-cni-cncf-io\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.069998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-conf-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.070608 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.069811 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 13:48:26.091323 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.091304 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lc7tc" Jun 06 13:48:26.096645 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.096621 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lc7tc" Jun 06 13:48:26.159649 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.159621 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 13:48:26.170114 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cnibin\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.170293 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/324ae047-307d-48e7-916b-6d19dc38016c-etc-tuned\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.170293 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.170293 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-system-cni-dir\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.170293 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.170293 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-os-release\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-kubernetes\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-host\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e54b170-c19f-43b1-b4ee-dc50595328ee-serviceca\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-kubelet\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-systemd\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb03a033-6909-4c2b-a70c-0e634874820f-agent-certs\") pod \"konnectivity-agent-v65zt\" (UID: \"bb03a033-6909-4c2b-a70c-0e634874820f\") " pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-device-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-kubelet\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-kubelet\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.170536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-systemd\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-device-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-kubelet\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovnkube-script-lib\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-var-lib-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-var-lib-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysconfig\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-hostroot\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-hostroot\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170815 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.170822 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e54b170-c19f-43b1-b4ee-dc50595328ee-serviceca\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-daemon-config\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.170898 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret podName:e1007746-5164-438c-ad0e-eb5d1ab2d351 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:26.670875975 +0000 UTC m=+2.999415624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret") pod "global-pull-secret-syncer-h9f4q" (UID: "e1007746-5164-438c-ad0e-eb5d1ab2d351") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-etc-selinux\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.171137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jc5s\" (UniqueName: \"kubernetes.io/projected/1215068a-20db-444e-a5ca-2641a62d8b94-kube-api-access-9jc5s\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.170985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-cni-netd\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovnkube-config\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b214ff39-d422-4f07-9180-798938c62cbd-tmp-dir\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/533391f9-7edf-4565-a564-a1e88cf5233a-host-slash\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovnkube-script-lib\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-etc-selinux\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171214 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-cni-netd\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-etc-kubernetes\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b214ff39-d422-4f07-9180-798938c62cbd-hosts-file\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-etc-kubernetes\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-sys\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-daemon-config\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89vh4\" (UniqueName: \"kubernetes.io/projected/324ae047-307d-48e7-916b-6d19dc38016c-kube-api-access-89vh4\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-cni-bin\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1007746-5164-438c-ad0e-eb5d1ab2d351-kubelet-config\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.171915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f59h\" (UniqueName: \"kubernetes.io/projected/533391f9-7edf-4565-a564-a1e88cf5233a-kube-api-access-9f59h\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171512 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-cni-bin\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysctl-d\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovnkube-config\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-lib-modules\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1007746-5164-438c-ad0e-eb5d1ab2d351-kubelet-config\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-var-lib-kubelet\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324ae047-307d-48e7-916b-6d19dc38016c-tmp\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-os-release\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-cni-binary-copy\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-os-release\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-netns\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-netns\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-systemd-units\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-ovn\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171837 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-systemd-units\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.172650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-systemd\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb03a033-6909-4c2b-a70c-0e634874820f-konnectivity-ca\") pod \"konnectivity-agent-v65zt\" (UID: \"bb03a033-6909-4c2b-a70c-0e634874820f\") " pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-run-ovn\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-cni-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.171969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-cni-multus\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-cni-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-var-lib-cni-multus\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysctl-conf\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9ctd\" (UniqueName: \"kubernetes.io/projected/8e54b170-c19f-43b1-b4ee-dc50595328ee-kube-api-access-c9ctd\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/533391f9-7edf-4565-a564-a1e88cf5233a-iptables-alerter-script\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-socket-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-run-netns\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-cni-binary-copy\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-run-netns\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-etc-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-socket-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.173536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-etc-openvswitch\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-modprobe-d\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e54b170-c19f-43b1-b4ee-dc50595328ee-host\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-cnibin\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172576 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-cnibin\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e54b170-c19f-43b1-b4ee-dc50595328ee-host\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-registration-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-sys-fs\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1007746-5164-438c-ad0e-eb5d1ab2d351-dbus\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-sys-fs\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172706 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1215068a-20db-444e-a5ca-2641a62d8b94-registration-dir\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-run\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172821 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb03a033-6909-4c2b-a70c-0e634874820f-konnectivity-ca\") pod \"konnectivity-agent-v65zt\" (UID: \"bb03a033-6909-4c2b-a70c-0e634874820f\") " pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.174338 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5zrb\" (UniqueName: \"kubernetes.io/projected/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-kube-api-access-z5zrb\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1007746-5164-438c-ad0e-eb5d1ab2d351-dbus\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-socket-dir-parent\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-k8s-cni-cncf-io\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-socket-dir-parent\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-conf-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-multus-conf-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.172985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-env-overrides\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-k8s-cni-cncf-io\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bzdv\" (UniqueName: \"kubernetes.io/projected/506fa8b1-e0db-4ee7-8b14-650330c41a4e-kube-api-access-8bzdv\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jdfk\" (UniqueName: \"kubernetes.io/projected/b214ff39-d422-4f07-9180-798938c62cbd-kube-api-access-8jdfk\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-multus-certs\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kftgz\" (UniqueName: \"kubernetes.io/projected/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-kube-api-access-kftgz\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-slash\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-node-log\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-log-socket\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-host-run-multus-certs\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173199 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-slash\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-node-log\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-log-socket\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9xv\" (UniqueName: \"kubernetes.io/projected/9299878a-be24-4725-a280-d9714a5b4ab4-kube-api-access-xc9xv\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-run-ovn-kubernetes\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-system-cni-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-cni-bin\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovn-node-metrics-cert\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173349 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-system-cni-dir\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/506fa8b1-e0db-4ee7-8b14-650330c41a4e-host-cni-bin\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.173355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/506fa8b1-e0db-4ee7-8b14-650330c41a4e-env-overrides\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.174329 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb03a033-6909-4c2b-a70c-0e634874820f-agent-certs\") pod \"konnectivity-agent-v65zt\" (UID: \"bb03a033-6909-4c2b-a70c-0e634874820f\") " pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.175876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.175805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/506fa8b1-e0db-4ee7-8b14-650330c41a4e-ovn-node-metrics-cert\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.180070 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.179812 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:48:26.180070 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.179838 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:48:26.180070 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.179852 2578 projected.go:196] Error preparing data for projected volume kube-api-access-spp7b for pod openshift-network-diagnostics/network-check-target-cjwh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:26.180070 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.179916 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b podName:7189fe1d-9959-4244-a14f-8205ab4f1482 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:26.679898108 +0000 UTC m=+3.008437778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-spp7b" (UniqueName: "kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b") pod "network-check-target-cjwh8" (UID: "7189fe1d-9959-4244-a14f-8205ab4f1482") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:26.182506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.182481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kftgz\" (UniqueName: \"kubernetes.io/projected/ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea-kube-api-access-kftgz\") pod \"multus-ghjj2\" (UID: \"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea\") " pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.182676 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.182655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bzdv\" (UniqueName: \"kubernetes.io/projected/506fa8b1-e0db-4ee7-8b14-650330c41a4e-kube-api-access-8bzdv\") pod \"ovnkube-node-wdgxr\" (UID: \"506fa8b1-e0db-4ee7-8b14-650330c41a4e\") " pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.182752 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.182658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9ctd\" (UniqueName: \"kubernetes.io/projected/8e54b170-c19f-43b1-b4ee-dc50595328ee-kube-api-access-c9ctd\") pod \"node-ca-rswsp\" (UID: \"8e54b170-c19f-43b1-b4ee-dc50595328ee\") " pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.182752 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.182663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jc5s\" (UniqueName: \"kubernetes.io/projected/1215068a-20db-444e-a5ca-2641a62d8b94-kube-api-access-9jc5s\") pod \"aws-ebs-csi-driver-node-7x9vm\" (UID: \"1215068a-20db-444e-a5ca-2641a62d8b94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.274096 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/533391f9-7edf-4565-a564-a1e88cf5233a-iptables-alerter-script\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.274263 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274263 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274455 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274554 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-modprobe-d\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.274554 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274554 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-run\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.274554 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5zrb\" (UniqueName: \"kubernetes.io/projected/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-kube-api-access-z5zrb\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jdfk\" (UniqueName: \"kubernetes.io/projected/b214ff39-d422-4f07-9180-798938c62cbd-kube-api-access-8jdfk\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9xv\" (UniqueName: \"kubernetes.io/projected/9299878a-be24-4725-a280-d9714a5b4ab4-kube-api-access-xc9xv\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cnibin\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/324ae047-307d-48e7-916b-6d19dc38016c-etc-tuned\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/533391f9-7edf-4565-a564-a1e88cf5233a-iptables-alerter-script\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.274758 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-system-cni-dir\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cnibin\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-run\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-os-release\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.274984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-kubernetes\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-modprobe-d\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-host\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-host\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-os-release\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-system-cni-dir\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysconfig\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-kubernetes\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b214ff39-d422-4f07-9180-798938c62cbd-tmp-dir\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysconfig\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.275203 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/533391f9-7edf-4565-a564-a1e88cf5233a-host-slash\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b214ff39-d422-4f07-9180-798938c62cbd-hosts-file\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.275274 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:26.775254668 +0000 UTC m=+3.103794332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275279 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/533391f9-7edf-4565-a564-a1e88cf5233a-host-slash\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b214ff39-d422-4f07-9180-798938c62cbd-hosts-file\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-sys\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89vh4\" (UniqueName: \"kubernetes.io/projected/324ae047-307d-48e7-916b-6d19dc38016c-kube-api-access-89vh4\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-sys\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f59h\" (UniqueName: \"kubernetes.io/projected/533391f9-7edf-4565-a564-a1e88cf5233a-kube-api-access-9f59h\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysctl-d\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-lib-modules\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-var-lib-kubelet\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324ae047-307d-48e7-916b-6d19dc38016c-tmp\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b214ff39-d422-4f07-9180-798938c62cbd-tmp-dir\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.275817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-var-lib-kubelet\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.276631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysctl-d\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.276631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-systemd\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.276631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-lib-modules\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.276631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysctl-conf\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.276631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-systemd\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.276631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275704 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.276631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.275731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/324ae047-307d-48e7-916b-6d19dc38016c-etc-sysctl-conf\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.277117 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.277097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/324ae047-307d-48e7-916b-6d19dc38016c-etc-tuned\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.277719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.277698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324ae047-307d-48e7-916b-6d19dc38016c-tmp\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.283394 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.283370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5zrb\" (UniqueName: \"kubernetes.io/projected/7fc70265-2e52-4cf0-a705-8a26a3d1ebe3-kube-api-access-z5zrb\") pod \"multus-additional-cni-plugins-nmmsg\" (UID: \"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3\") " pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.284345 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.284321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jdfk\" (UniqueName: \"kubernetes.io/projected/b214ff39-d422-4f07-9180-798938c62cbd-kube-api-access-8jdfk\") pod \"node-resolver-vvtkr\" (UID: \"b214ff39-d422-4f07-9180-798938c62cbd\") " pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.284631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.284614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f59h\" (UniqueName: \"kubernetes.io/projected/533391f9-7edf-4565-a564-a1e88cf5233a-kube-api-access-9f59h\") pod \"iptables-alerter-hccgx\" (UID: \"533391f9-7edf-4565-a564-a1e88cf5233a\") " pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.284914 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.284893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89vh4\" (UniqueName: \"kubernetes.io/projected/324ae047-307d-48e7-916b-6d19dc38016c-kube-api-access-89vh4\") pod \"tuned-mxfvn\" (UID: \"324ae047-307d-48e7-916b-6d19dc38016c\") " pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.285062 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.285044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9xv\" (UniqueName: \"kubernetes.io/projected/9299878a-be24-4725-a280-d9714a5b4ab4-kube-api-access-xc9xv\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:26.363036 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.362991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rswsp" Jun 06 13:48:26.372032 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.371823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" Jun 06 13:48:26.378933 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.378914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:26.385734 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.385716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:26.391430 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.391404 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ghjj2" Jun 06 13:48:26.397991 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.397966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vvtkr" Jun 06 13:48:26.403635 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.403616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" Jun 06 13:48:26.412184 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.412165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hccgx" Jun 06 13:48:26.416794 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.416774 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" Jun 06 13:48:26.526107 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.526081 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:48:26.678067 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.677973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:26.678193 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.678146 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:26.678264 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.678219 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret podName:e1007746-5164-438c-ad0e-eb5d1ab2d351 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:27.678199027 +0000 UTC m=+4.006738678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret") pod "global-pull-secret-syncer-h9f4q" (UID: "e1007746-5164-438c-ad0e-eb5d1ab2d351") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:26.778945 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.778913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:26.779126 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:26.778973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:26.779126 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.779075 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:26.779126 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.779107 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:48:26.779126 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.779123 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:48:26.779345 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.779133 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:27.77911731 +0000 UTC m=+4.107656960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:26.779345 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.779135 2578 projected.go:196] Error preparing data for projected volume kube-api-access-spp7b for pod openshift-network-diagnostics/network-check-target-cjwh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:26.779345 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:26.779220 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b podName:7189fe1d-9959-4244-a14f-8205ab4f1482 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:27.779169239 +0000 UTC m=+4.107708897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-spp7b" (UniqueName: "kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b") pod "network-check-target-cjwh8" (UID: "7189fe1d-9959-4244-a14f-8205ab4f1482") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:26.874851 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.874827 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e54b170_c19f_43b1_b4ee_dc50595328ee.slice/crio-0869f2d6b080709a7f83abf94e5df240bfbbdf1b3982fa93efdf701d19561334 WatchSource:0}: Error finding container 0869f2d6b080709a7f83abf94e5df240bfbbdf1b3982fa93efdf701d19561334: Status 404 returned error can't find the container with id 0869f2d6b080709a7f83abf94e5df240bfbbdf1b3982fa93efdf701d19561334 Jun 06 13:48:26.875778 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.875746 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533391f9_7edf_4565_a564_a1e88cf5233a.slice/crio-e23e59646b7ab47668171bbfc20247b55838eefc42256e1ade1984b215ca5df3 WatchSource:0}: Error finding container e23e59646b7ab47668171bbfc20247b55838eefc42256e1ade1984b215ca5df3: Status 404 returned error can't find the container with id e23e59646b7ab47668171bbfc20247b55838eefc42256e1ade1984b215ca5df3 Jun 06 13:48:26.879587 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.879555 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee22ebaa_1d9a_4a7e_bb6a_da8eecdbc5ea.slice/crio-aa13116209f5b843be3c1d087ba5e43092411ca217beca5f6475409dcf490cd7 WatchSource:0}: Error finding container aa13116209f5b843be3c1d087ba5e43092411ca217beca5f6475409dcf490cd7: Status 404 returned error can't find the container with id aa13116209f5b843be3c1d087ba5e43092411ca217beca5f6475409dcf490cd7 Jun 06 13:48:26.881745 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.881719 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb03a033_6909_4c2b_a70c_0e634874820f.slice/crio-2e8e1186b133f1d839916d364f65c7a0917af0aa47c904cdbb01b96684c7480f WatchSource:0}: Error finding container 2e8e1186b133f1d839916d364f65c7a0917af0aa47c904cdbb01b96684c7480f: Status 404 returned error can't find the container with id 2e8e1186b133f1d839916d364f65c7a0917af0aa47c904cdbb01b96684c7480f Jun 06 13:48:26.882437 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.882416 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324ae047_307d_48e7_916b_6d19dc38016c.slice/crio-d404c101cb091ecc0822517e4f8cd93174f9ff7eae14bcdb559c53c5176ef048 WatchSource:0}: Error finding container d404c101cb091ecc0822517e4f8cd93174f9ff7eae14bcdb559c53c5176ef048: Status 404 returned error can't find the container with id d404c101cb091ecc0822517e4f8cd93174f9ff7eae14bcdb559c53c5176ef048 Jun 06 13:48:26.884130 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.884103 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc70265_2e52_4cf0_a705_8a26a3d1ebe3.slice/crio-1937f3b0ed8b21a313d0afd68fc8f80a135f710191e22239043f0efd4eb2386d WatchSource:0}: Error finding container 1937f3b0ed8b21a313d0afd68fc8f80a135f710191e22239043f0efd4eb2386d: Status 404 returned error can't find the container with id 1937f3b0ed8b21a313d0afd68fc8f80a135f710191e22239043f0efd4eb2386d Jun 06 13:48:26.884943 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.884855 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb214ff39_d422_4f07_9180_798938c62cbd.slice/crio-d7f9eb1ff54940f76930f51cb0c2247abc555c4eec7d7339d5a2348798a84cd5 WatchSource:0}: Error finding container d7f9eb1ff54940f76930f51cb0c2247abc555c4eec7d7339d5a2348798a84cd5: Status 404 returned error can't find the container with id d7f9eb1ff54940f76930f51cb0c2247abc555c4eec7d7339d5a2348798a84cd5 Jun 06 13:48:26.907513 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.907487 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1215068a_20db_444e_a5ca_2641a62d8b94.slice/crio-0139f8c64f6d7f9ba9dd527a5a35293082bc99f8c9530d19f4dd7a5b43b3b005 WatchSource:0}: Error finding container 0139f8c64f6d7f9ba9dd527a5a35293082bc99f8c9530d19f4dd7a5b43b3b005: Status 404 returned error can't find the container with id 0139f8c64f6d7f9ba9dd527a5a35293082bc99f8c9530d19f4dd7a5b43b3b005 Jun 06 13:48:26.908128 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:26.908079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506fa8b1_e0db_4ee7_8b14_650330c41a4e.slice/crio-6834fb6dd929d5ce0d6009ab1e8ace2c50d58e86c17eb157f490f781dad88b42 WatchSource:0}: Error finding container 6834fb6dd929d5ce0d6009ab1e8ace2c50d58e86c17eb157f490f781dad88b42: Status 404 returned error can't find the container with id 6834fb6dd929d5ce0d6009ab1e8ace2c50d58e86c17eb157f490f781dad88b42 Jun 06 13:48:27.099383 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.099341 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 13:43:26 +0000 UTC" deadline="2028-01-06 10:01:10.756744103 +0000 UTC" Jun 06 13:48:27.099383 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.099379 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13892h12m43.657370134s" Jun 06 13:48:27.139897 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.139867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vvtkr" event={"ID":"b214ff39-d422-4f07-9180-798938c62cbd","Type":"ContainerStarted","Data":"d7f9eb1ff54940f76930f51cb0c2247abc555c4eec7d7339d5a2348798a84cd5"} Jun 06 13:48:27.142391 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.142368 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerStarted","Data":"1937f3b0ed8b21a313d0afd68fc8f80a135f710191e22239043f0efd4eb2386d"} Jun 06 13:48:27.143492 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.143468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghjj2" event={"ID":"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea","Type":"ContainerStarted","Data":"aa13116209f5b843be3c1d087ba5e43092411ca217beca5f6475409dcf490cd7"} Jun 06 13:48:27.144602 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.144575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rswsp" event={"ID":"8e54b170-c19f-43b1-b4ee-dc50595328ee","Type":"ContainerStarted","Data":"0869f2d6b080709a7f83abf94e5df240bfbbdf1b3982fa93efdf701d19561334"} Jun 06 13:48:27.146574 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.146553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" event={"ID":"b2f79e97766e8282ec015d0786dde0e4","Type":"ContainerStarted","Data":"114c2962c6efef792cca1d7317cde31ef1fec52d899f317f695c1c37e3910483"} Jun 06 13:48:27.147514 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.147489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" event={"ID":"1215068a-20db-444e-a5ca-2641a62d8b94","Type":"ContainerStarted","Data":"0139f8c64f6d7f9ba9dd527a5a35293082bc99f8c9530d19f4dd7a5b43b3b005"} Jun 06 13:48:27.148641 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.148617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" event={"ID":"324ae047-307d-48e7-916b-6d19dc38016c","Type":"ContainerStarted","Data":"d404c101cb091ecc0822517e4f8cd93174f9ff7eae14bcdb559c53c5176ef048"} Jun 06 13:48:27.149530 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.149509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v65zt" event={"ID":"bb03a033-6909-4c2b-a70c-0e634874820f","Type":"ContainerStarted","Data":"2e8e1186b133f1d839916d364f65c7a0917af0aa47c904cdbb01b96684c7480f"} Jun 06 13:48:27.152268 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.152244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hccgx" event={"ID":"533391f9-7edf-4565-a564-a1e88cf5233a","Type":"ContainerStarted","Data":"e23e59646b7ab47668171bbfc20247b55838eefc42256e1ade1984b215ca5df3"} Jun 06 13:48:27.153423 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.153400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"6834fb6dd929d5ce0d6009ab1e8ace2c50d58e86c17eb157f490f781dad88b42"} Jun 06 13:48:27.162283 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.162236 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-222.ec2.internal" podStartSLOduration=2.162203765 podStartE2EDuration="2.162203765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:27.161693422 +0000 UTC m=+3.490233092" watchObservedRunningTime="2026-06-06 13:48:27.162203765 +0000 UTC m=+3.490743434" Jun 06 13:48:27.691587 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.691543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:27.691774 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.691704 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:27.691838 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.691781 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret podName:e1007746-5164-438c-ad0e-eb5d1ab2d351 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:29.691760929 +0000 UTC m=+6.020300588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret") pod "global-pull-secret-syncer-h9f4q" (UID: "e1007746-5164-438c-ad0e-eb5d1ab2d351") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:27.792322 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.792283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:27.792502 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:27.792384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:27.793173 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.792560 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:48:27.793173 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.792584 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:48:27.793173 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.792597 2578 projected.go:196] Error preparing data for projected volume kube-api-access-spp7b for pod openshift-network-diagnostics/network-check-target-cjwh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:27.793173 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.792660 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b podName:7189fe1d-9959-4244-a14f-8205ab4f1482 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:29.792640194 +0000 UTC m=+6.121179870 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-spp7b" (UniqueName: "kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b") pod "network-check-target-cjwh8" (UID: "7189fe1d-9959-4244-a14f-8205ab4f1482") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:27.793173 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.793066 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:27.793173 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:27.793114 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:29.793097536 +0000 UTC m=+6.121637184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:28.103132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:28.103002 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 13:43:26 +0000 UTC" deadline="2028-01-04 12:16:36.016816282 +0000 UTC" Jun 06 13:48:28.103132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:28.103082 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13846h28m7.913739464s" Jun 06 13:48:28.133974 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:28.133942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:28.134145 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:28.134091 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:28.134548 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:28.134527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:28.134650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:28.134559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:28.134704 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:28.134651 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:28.134766 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:28.134732 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:28.173419 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:28.173383 2578 generic.go:356] "Generic (PLEG): container finished" podID="4d2d242d7fadb7e7995ee7515441554c" containerID="32350a0858d4dffbcbb60460b4331a92fd9ed191240d2db4d5e888479bb890de" exitCode=0 Jun 06 13:48:28.174344 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:28.174313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" event={"ID":"4d2d242d7fadb7e7995ee7515441554c","Type":"ContainerDied","Data":"32350a0858d4dffbcbb60460b4331a92fd9ed191240d2db4d5e888479bb890de"} Jun 06 13:48:29.199374 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:29.199279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" event={"ID":"4d2d242d7fadb7e7995ee7515441554c","Type":"ContainerStarted","Data":"205c656ce17b3b17c1b07051add930fb5159efea0129197ecb5e8eb76f37f967"} Jun 06 13:48:29.213965 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:29.213591 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-222.ec2.internal" podStartSLOduration=4.213568067 podStartE2EDuration="4.213568067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:29.212620575 +0000 UTC m=+5.541160242" watchObservedRunningTime="2026-06-06 13:48:29.213568067 +0000 UTC m=+5.542107736" Jun 06 13:48:29.709788 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:29.709178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:29.709788 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.709363 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:29.709788 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.709430 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret podName:e1007746-5164-438c-ad0e-eb5d1ab2d351 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:33.709409133 +0000 UTC m=+10.037948807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret") pod "global-pull-secret-syncer-h9f4q" (UID: "e1007746-5164-438c-ad0e-eb5d1ab2d351") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:29.809992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:29.810086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.810261 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.810280 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.810295 2578 projected.go:196] Error preparing data for projected volume kube-api-access-spp7b for pod openshift-network-diagnostics/network-check-target-cjwh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.810356 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b podName:7189fe1d-9959-4244-a14f-8205ab4f1482 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:33.8103356 +0000 UTC m=+10.138875264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-spp7b" (UniqueName: "kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b") pod "network-check-target-cjwh8" (UID: "7189fe1d-9959-4244-a14f-8205ab4f1482") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.810757 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:29.810843 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:29.810808 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:33.810790852 +0000 UTC m=+10.139330526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:30.133719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:30.132856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:30.133719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:30.132985 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:30.133719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:30.133411 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:30.133719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:30.133519 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:30.133719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:30.133571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:30.133719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:30.133684 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:32.132665 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:32.132630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:32.133169 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:32.132630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:32.133169 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:32.132771 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:32.133169 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:32.132786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:32.133169 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:32.132884 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:32.133169 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:32.132978 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:33.746063 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:33.746016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:33.746549 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.746175 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:33.746549 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.746256 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret podName:e1007746-5164-438c-ad0e-eb5d1ab2d351 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:41.746235207 +0000 UTC m=+18.074774853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret") pod "global-pull-secret-syncer-h9f4q" (UID: "e1007746-5164-438c-ad0e-eb5d1ab2d351") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:33.847457 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:33.847341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:33.847457 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:33.847401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:33.847457 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.847453 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:33.847719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.847511 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:41.84749334 +0000 UTC m=+18.176032989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:33.847719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.847562 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:48:33.847719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.847590 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:48:33.847719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.847604 2578 projected.go:196] Error preparing data for projected volume kube-api-access-spp7b for pod openshift-network-diagnostics/network-check-target-cjwh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:33.847719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:33.847659 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b podName:7189fe1d-9959-4244-a14f-8205ab4f1482 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:41.847642001 +0000 UTC m=+18.176181668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-spp7b" (UniqueName: "kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b") pod "network-check-target-cjwh8" (UID: "7189fe1d-9959-4244-a14f-8205ab4f1482") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:34.135034 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:34.134979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:34.135216 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:34.135116 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:34.135216 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:34.135175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:34.135326 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:34.135249 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:34.135631 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:34.135612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:34.135747 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:34.135727 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:36.132334 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:36.132296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:36.132757 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:36.132296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:36.132757 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:36.132296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:36.132757 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:36.132522 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:36.132757 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:36.132433 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:36.132757 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:36.132631 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:38.135088 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:38.135058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:38.135468 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:38.135058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:38.135468 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:38.135160 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:38.135468 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:38.135245 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:38.135468 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:38.135058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:38.135468 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:38.135326 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:40.132240 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:40.132205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:40.132240 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:40.132242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:40.132766 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:40.132205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:40.132766 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:40.132365 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:40.132766 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:40.132442 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:40.132766 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:40.132496 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:41.802561 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:41.802521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:41.803041 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.802644 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:41.803041 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.802700 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret podName:e1007746-5164-438c-ad0e-eb5d1ab2d351 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:57.802682825 +0000 UTC m=+34.131222469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret") pod "global-pull-secret-syncer-h9f4q" (UID: "e1007746-5164-438c-ad0e-eb5d1ab2d351") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:41.903367 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:41.903328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:41.903518 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:41.903382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:41.903518 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.903485 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:41.903518 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.903515 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:48:41.903674 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.903531 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:48:41.903674 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.903543 2578 projected.go:196] Error preparing data for projected volume kube-api-access-spp7b for pod openshift-network-diagnostics/network-check-target-cjwh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:41.903674 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.903564 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:57.903544031 +0000 UTC m=+34.232083678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:41.903674 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:41.903592 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b podName:7189fe1d-9959-4244-a14f-8205ab4f1482 nodeName:}" failed. No retries permitted until 2026-06-06 13:48:57.903576508 +0000 UTC m=+34.232116167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-spp7b" (UniqueName: "kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b") pod "network-check-target-cjwh8" (UID: "7189fe1d-9959-4244-a14f-8205ab4f1482") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:42.132299 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:42.132230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:42.132500 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:42.132237 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:42.132500 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:42.132370 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:42.132500 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:42.132243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:42.132500 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:42.132430 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:42.132706 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:42.132521 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:44.132967 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:44.132873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:44.133418 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:44.132997 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:44.133418 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:44.133017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:44.133418 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:44.133111 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:44.133418 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:44.133149 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:44.133418 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:44.133272 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:46.132426 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.132106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:46.133013 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.132106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:46.133013 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:46.132469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:46.133013 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:46.132560 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:46.133013 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.132176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:46.133013 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:46.132673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:46.238856 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.238822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vvtkr" event={"ID":"b214ff39-d422-4f07-9180-798938c62cbd","Type":"ContainerStarted","Data":"f7c2e6665c22e05700a08b683e4f4a102bb646f412bc5c524625f7aa2ea5d9c2"} Jun 06 13:48:46.240625 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.240594 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fc70265-2e52-4cf0-a705-8a26a3d1ebe3" containerID="fbc27612aee73ff0800435f4741ddf93217eb5f5f574a3cc990b24327d5da42a" exitCode=0 Jun 06 13:48:46.240739 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.240679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerDied","Data":"fbc27612aee73ff0800435f4741ddf93217eb5f5f574a3cc990b24327d5da42a"} Jun 06 13:48:46.242298 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.242271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ghjj2" event={"ID":"ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea","Type":"ContainerStarted","Data":"9dc942d32106894d54d656a181d2f9406119e1856bef2b59245e5f7ba4547723"} Jun 06 13:48:46.244187 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.243855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rswsp" event={"ID":"8e54b170-c19f-43b1-b4ee-dc50595328ee","Type":"ContainerStarted","Data":"08f4825c03d43af0305f15f728b17ead0f3de172fabcc2bd97d00a049e037cb6"} Jun 06 13:48:46.245449 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.245421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" event={"ID":"1215068a-20db-444e-a5ca-2641a62d8b94","Type":"ContainerStarted","Data":"67edc6ea50c0473fa63b2cc0a5060742a4f7d5873a866056fbeeef9522404f27"} Jun 06 13:48:46.247151 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.247108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" event={"ID":"324ae047-307d-48e7-916b-6d19dc38016c","Type":"ContainerStarted","Data":"f5fbeac7b2258a869d62473118c547247746dde2797de6878fe37fe73a433e33"} Jun 06 13:48:46.248690 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.248665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v65zt" event={"ID":"bb03a033-6909-4c2b-a70c-0e634874820f","Type":"ContainerStarted","Data":"8d96bab9c97f145fba2bcf097fb0f7928bd1bb033802add5db7d387c95a8d3c3"} Jun 06 13:48:46.251757 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.251738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"342e2955b958477c933314aeec4fbe00789cb8d9051402d5b557989c3a05f8a3"} Jun 06 13:48:46.251849 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.251809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"30ff4e7b98e442c6a685cd7cf1d716275628969f93802117fdfc7aea821c6f6f"} Jun 06 13:48:46.251908 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.251859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"722af190ef778e2ccbc0c3fe57569e06056d9021e76d475e1a7f7260538bec6b"} Jun 06 13:48:46.251908 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.251903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"6f951a8aeb8bbb10bb95da8f8da8d34ee78b97f0404fe15923da8f14231129b7"} Jun 06 13:48:46.252008 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.251892 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vvtkr" podStartSLOduration=3.654554831 podStartE2EDuration="22.251875613s" totalImagesPullingTime="18.597320782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:46.251841355 +0000 UTC m=+22.580381022" watchObservedRunningTime="2026-06-06 13:48:46.251875613 +0000 UTC m=+22.580415281" Jun 06 13:48:46.252008 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.251950 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"4b85ba5bbc7dd2decd9a18accf56f9fb0bdc9e8968d21eb037958b2daa2ce832"} Jun 06 13:48:46.252008 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.251987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"aac1743a960cf67d9d7918b1c2cc42b5c4cf7663e54964416abe5c4a0787cf16"} Jun 06 13:48:46.263869 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.263825 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rswsp" podStartSLOduration=3.608176825 podStartE2EDuration="22.263812718s" totalImagesPullingTime="18.655635893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:46.263587035 +0000 UTC m=+22.592126714" watchObservedRunningTime="2026-06-06 13:48:46.263812718 +0000 UTC m=+22.592352386" Jun 06 13:48:46.277771 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.277736 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v65zt" podStartSLOduration=8.3561907 podStartE2EDuration="22.27772306s" totalImagesPullingTime="13.92153236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:46.277379156 +0000 UTC m=+22.605918823" watchObservedRunningTime="2026-06-06 13:48:46.27772306 +0000 UTC m=+22.606262724" Jun 06 13:48:46.304981 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.304929 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ghjj2" podStartSLOduration=3.642927409 podStartE2EDuration="22.30491134s" totalImagesPullingTime="18.661983931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:46.304764479 +0000 UTC m=+22.633304200" watchObservedRunningTime="2026-06-06 13:48:46.30491134 +0000 UTC m=+22.633451010" Jun 06 13:48:46.635914 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:46.635884 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 13:48:47.135117 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:47.134905 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T13:48:46.635900486Z","UUID":"c5c275a7-116e-42dd-92fc-b8afba61d703","Handler":null,"Name":"","Endpoint":""} Jun 06 13:48:47.138139 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:47.138117 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 13:48:47.138259 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:47.138162 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 13:48:47.256079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:47.256046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" event={"ID":"1215068a-20db-444e-a5ca-2641a62d8b94","Type":"ContainerStarted","Data":"092c9deecf4ec56629d27cde8c5a12915476c5a9af304c5e30dc075ea3e5a96f"} Jun 06 13:48:47.257885 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:47.257856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hccgx" event={"ID":"533391f9-7edf-4565-a564-a1e88cf5233a","Type":"ContainerStarted","Data":"6670a5447709665b8c540fb85b3b256d78ef908bc2445f3facaa6e67a61e7fa4"} Jun 06 13:48:47.271283 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:47.271229 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mxfvn" podStartSLOduration=4.622115276 podStartE2EDuration="23.271211693s" totalImagesPullingTime="18.649096417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:46.345190405 +0000 UTC m=+22.673730103" watchObservedRunningTime="2026-06-06 13:48:47.271211693 +0000 UTC m=+23.599751365" Jun 06 13:48:47.272125 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:47.272083 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hccgx" podStartSLOduration=4.616919313 podStartE2EDuration="23.272070561s" totalImagesPullingTime="18.655151248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:47.271394209 +0000 UTC m=+23.599933904" watchObservedRunningTime="2026-06-06 13:48:47.272070561 +0000 UTC m=+23.600610232" Jun 06 13:48:48.132741 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:48.132522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:48.132865 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:48.132602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:48.133001 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:48.132865 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:48.133001 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:48.132905 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:48.133001 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:48.132634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:48.133001 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:48.132986 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:48.262513 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:48.262475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" event={"ID":"1215068a-20db-444e-a5ca-2641a62d8b94","Type":"ContainerStarted","Data":"5011271c59c494389b1e816738cf311522f9387a39a082ac71fa07520e0f1170"} Jun 06 13:48:48.266234 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:48.266202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"140b9cc3af0216c5e629ada49cc954d29696aeea96d15eb55167bca50eeb5031"} Jun 06 13:48:48.278037 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:48.277972 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7x9vm" podStartSLOduration=4.069776891 podStartE2EDuration="24.277957105s" totalImagesPullingTime="20.208180214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:48.277898563 +0000 UTC m=+24.606438232" watchObservedRunningTime="2026-06-06 13:48:48.277957105 +0000 UTC m=+24.606496766" Jun 06 13:48:50.132017 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:50.131982 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:50.132565 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:50.132118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:50.132565 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:50.132138 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:50.132565 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:50.132212 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:50.132565 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:50.132250 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:50.132565 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:50.132315 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:50.883054 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:50.882869 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:50.883456 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:50.883438 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:51.275682 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.275650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" event={"ID":"506fa8b1-e0db-4ee7-8b14-650330c41a4e","Type":"ContainerStarted","Data":"ddb4470b17b70c984c70d2e056971c8daffb9901c494273bec1e888935497840"} Jun 06 13:48:51.276486 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.275943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:51.276486 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.276014 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:51.276486 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.276079 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:51.277532 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.277506 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fc70265-2e52-4cf0-a705-8a26a3d1ebe3" containerID="200adf574fbaa941bc04277f4a6efecd18db5b410b0c12ae702cf842a63a06d0" exitCode=0 Jun 06 13:48:51.277643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.277546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerDied","Data":"200adf574fbaa941bc04277f4a6efecd18db5b410b0c12ae702cf842a63a06d0"} Jun 06 13:48:51.277873 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.277838 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:51.279077 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.278299 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v65zt" Jun 06 13:48:51.291381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.291358 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:51.291592 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.291578 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:48:51.299182 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:51.299146 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" podStartSLOduration=8.61977092 podStartE2EDuration="27.299133997s" totalImagesPullingTime="18.679363077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:48:51.297795302 +0000 UTC m=+27.626334982" watchObservedRunningTime="2026-06-06 13:48:51.299133997 +0000 UTC m=+27.627673645" Jun 06 13:48:52.132090 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.131980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:52.132324 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.131980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:52.132324 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:52.132119 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:52.132324 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.132144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:52.132324 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:52.132227 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:52.132324 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:52.132297 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:52.383549 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.383368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjwh8"] Jun 06 13:48:52.383889 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.383602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:52.383889 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:52.383719 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:52.389887 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.389529 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9f4q"] Jun 06 13:48:52.389887 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.389693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:52.389887 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:52.389836 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:52.391120 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.391089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbklr"] Jun 06 13:48:52.391239 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:52.391198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:52.391388 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:52.391296 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:53.283316 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:53.283285 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fc70265-2e52-4cf0-a705-8a26a3d1ebe3" containerID="171ba8098bb91ebb77c1a24f80de34539861ea4177081f1a694c243273ad7dcb" exitCode=0 Jun 06 13:48:53.283682 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:53.283368 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerDied","Data":"171ba8098bb91ebb77c1a24f80de34539861ea4177081f1a694c243273ad7dcb"} Jun 06 13:48:54.132933 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:54.132898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:54.133452 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:54.132999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:54.133452 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:54.133064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:54.133452 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:54.133148 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:54.133602 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:54.133575 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:54.133721 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:54.133696 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:55.290440 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:55.290407 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fc70265-2e52-4cf0-a705-8a26a3d1ebe3" containerID="4a2babf7d25d5793e2106aca3b09ba526ef23e2dc0f6d64a33563c8d0c9d44b9" exitCode=0 Jun 06 13:48:55.291017 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:55.290447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerDied","Data":"4a2babf7d25d5793e2106aca3b09ba526ef23e2dc0f6d64a33563c8d0c9d44b9"} Jun 06 13:48:56.132753 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:56.132721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:56.132908 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:56.132780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:56.132908 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:56.132784 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:56.132908 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:56.132876 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:56.133067 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:56.133000 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:56.133130 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:56.133114 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:57.819267 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:57.819226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:57.819780 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.819379 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:57.819780 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.819455 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret podName:e1007746-5164-438c-ad0e-eb5d1ab2d351 nodeName:}" failed. No retries permitted until 2026-06-06 13:49:29.819434248 +0000 UTC m=+66.147973910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret") pod "global-pull-secret-syncer-h9f4q" (UID: "e1007746-5164-438c-ad0e-eb5d1ab2d351") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:48:57.920583 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:57.920549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:57.920765 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:57.920599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:57.920765 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.920698 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:57.920765 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.920713 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:48:57.920765 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.920727 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:48:57.920765 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.920739 2578 projected.go:196] Error preparing data for projected volume kube-api-access-spp7b for pod openshift-network-diagnostics/network-check-target-cjwh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:57.920765 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.920768 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:49:29.920746774 +0000 UTC m=+66.249286439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:48:57.921101 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:57.920784 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b podName:7189fe1d-9959-4244-a14f-8205ab4f1482 nodeName:}" failed. No retries permitted until 2026-06-06 13:49:29.920777549 +0000 UTC m=+66.249317195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-spp7b" (UniqueName: "kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b") pod "network-check-target-cjwh8" (UID: "7189fe1d-9959-4244-a14f-8205ab4f1482") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:48:58.132673 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.132648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:48:58.132848 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.132692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:48:58.132848 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.132794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:48:58.132848 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:58.132811 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cjwh8" podUID="7189fe1d-9959-4244-a14f-8205ab4f1482" Jun 06 13:48:58.133081 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:58.132912 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:48:58.133081 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:58.132994 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9f4q" podUID="e1007746-5164-438c-ad0e-eb5d1ab2d351" Jun 06 13:48:58.439408 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.439381 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-222.ec2.internal" event="NodeReady" Jun 06 13:48:58.439597 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.439534 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 13:48:58.477961 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.477928 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9jfsf"] Jun 06 13:48:58.512437 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.512406 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hd6gw"] Jun 06 13:48:58.512596 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.512571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.515074 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.515052 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2x485\"" Jun 06 13:48:58.515216 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.515197 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 13:48:58.515308 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.515299 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 13:48:58.528339 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.528319 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9jfsf"] Jun 06 13:48:58.528439 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.528359 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hd6gw"] Jun 06 13:48:58.528439 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.528397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:58.530845 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.530824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9wxzl\"" Jun 06 13:48:58.530963 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.530898 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 13:48:58.530963 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.530945 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 13:48:58.531376 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.531357 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 13:48:58.624875 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.624841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmn2r\" (UniqueName: \"kubernetes.io/projected/9bfa30a8-3e12-4903-a2c5-953bea0cecdc-kube-api-access-bmn2r\") pod \"ingress-canary-hd6gw\" (UID: \"9bfa30a8-3e12-4903-a2c5-953bea0cecdc\") " pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:58.625079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.624883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.625079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.624929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-config-volume\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.625079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.624955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qlb9\" (UniqueName: \"kubernetes.io/projected/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-kube-api-access-7qlb9\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.625079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.625064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bfa30a8-3e12-4903-a2c5-953bea0cecdc-cert\") pod \"ingress-canary-hd6gw\" (UID: \"9bfa30a8-3e12-4903-a2c5-953bea0cecdc\") " pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:58.625266 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.625098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-tmp-dir\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.726201 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.726115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-config-volume\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.726201 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.726155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qlb9\" (UniqueName: \"kubernetes.io/projected/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-kube-api-access-7qlb9\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.726201 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.726189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bfa30a8-3e12-4903-a2c5-953bea0cecdc-cert\") pod \"ingress-canary-hd6gw\" (UID: \"9bfa30a8-3e12-4903-a2c5-953bea0cecdc\") " pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:58.726545 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.726225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-tmp-dir\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.726545 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.726276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn2r\" (UniqueName: \"kubernetes.io/projected/9bfa30a8-3e12-4903-a2c5-953bea0cecdc-kube-api-access-bmn2r\") pod \"ingress-canary-hd6gw\" (UID: \"9bfa30a8-3e12-4903-a2c5-953bea0cecdc\") " pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:58.726545 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.726307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.726545 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:58.726429 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:48:58.726545 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:58.726488 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:48:59.226470764 +0000 UTC m=+35.555010409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:48:58.726950 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.726843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-config-volume\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.727037 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.727004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-tmp-dir\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.731103 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.731082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9bfa30a8-3e12-4903-a2c5-953bea0cecdc-cert\") pod \"ingress-canary-hd6gw\" (UID: \"9bfa30a8-3e12-4903-a2c5-953bea0cecdc\") " pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:58.735474 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.735427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qlb9\" (UniqueName: \"kubernetes.io/projected/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-kube-api-access-7qlb9\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:58.735842 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.735820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmn2r\" (UniqueName: \"kubernetes.io/projected/9bfa30a8-3e12-4903-a2c5-953bea0cecdc-kube-api-access-bmn2r\") pod \"ingress-canary-hd6gw\" (UID: \"9bfa30a8-3e12-4903-a2c5-953bea0cecdc\") " pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:58.837974 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:58.837934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hd6gw" Jun 06 13:48:59.229447 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:59.229409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:48:59.229652 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:59.229592 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:48:59.229719 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:48:59.229694 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:49:00.229671367 +0000 UTC m=+36.558211019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:48:59.617074 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:48:59.617043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hd6gw"] Jun 06 13:48:59.620853 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:48:59.620827 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfa30a8_3e12_4903_a2c5_953bea0cecdc.slice/crio-da02aee7f0e5ecf7b511880e50869d21d5ce195fe71cb65c64c4c72ab9f07457 WatchSource:0}: Error finding container da02aee7f0e5ecf7b511880e50869d21d5ce195fe71cb65c64c4c72ab9f07457: Status 404 returned error can't find the container with id da02aee7f0e5ecf7b511880e50869d21d5ce195fe71cb65c64c4c72ab9f07457 Jun 06 13:49:00.132490 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.132459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:49:00.132954 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.132456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:49:00.132954 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.132475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:49:00.136348 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.136139 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 13:49:00.136348 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.136159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 13:49:00.136348 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.136169 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 13:49:00.136348 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.136227 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 13:49:00.136348 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.136174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb9zz\"" Jun 06 13:49:00.136622 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.136480 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9lr7\"" Jun 06 13:49:00.236256 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.236217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:49:00.236427 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:00.236387 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:49:00.236482 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:00.236469 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:49:02.236445712 +0000 UTC m=+38.564985360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:49:00.304016 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.303978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hd6gw" event={"ID":"9bfa30a8-3e12-4903-a2c5-953bea0cecdc","Type":"ContainerStarted","Data":"da02aee7f0e5ecf7b511880e50869d21d5ce195fe71cb65c64c4c72ab9f07457"} Jun 06 13:49:00.307044 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.307001 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fc70265-2e52-4cf0-a705-8a26a3d1ebe3" containerID="871e677ea0266e1fdc4ebf7f8e62c43cf50be7f48f03d4ec3f996f2c9a062720" exitCode=0 Jun 06 13:49:00.307175 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:00.307057 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerDied","Data":"871e677ea0266e1fdc4ebf7f8e62c43cf50be7f48f03d4ec3f996f2c9a062720"} Jun 06 13:49:01.312333 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:01.312170 2578 generic.go:356] "Generic (PLEG): container finished" podID="7fc70265-2e52-4cf0-a705-8a26a3d1ebe3" containerID="c4c12835205947f77afb5c5abf6078586ffd459478fd2d5ceea260b8cdde423e" exitCode=0 Jun 06 13:49:01.312686 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:01.312243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerDied","Data":"c4c12835205947f77afb5c5abf6078586ffd459478fd2d5ceea260b8cdde423e"} Jun 06 13:49:02.249273 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:02.249190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:49:02.249416 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:02.249307 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:49:02.249416 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:02.249363 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:49:06.249350283 +0000 UTC m=+42.577889927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:49:02.317995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:02.317964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" event={"ID":"7fc70265-2e52-4cf0-a705-8a26a3d1ebe3","Type":"ContainerStarted","Data":"d9f4025269ca64011df1a85c2a183978d5238b22dba1626c4885ca3eba75da6c"} Jun 06 13:49:02.319449 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:02.319424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hd6gw" event={"ID":"9bfa30a8-3e12-4903-a2c5-953bea0cecdc","Type":"ContainerStarted","Data":"8526e9399a743e0708fde676f5294353bc424f9d4eecf59dc5a0a3b5209965ce"} Jun 06 13:49:02.338779 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:02.338723 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nmmsg" podStartSLOduration=8.71230301 podStartE2EDuration="38.338708114s" totalImagesPullingTime="29.626405104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:49:02.337249119 +0000 UTC m=+38.665788799" watchObservedRunningTime="2026-06-06 13:49:02.338708114 +0000 UTC m=+38.667247780" Jun 06 13:49:02.354171 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:02.354119 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hd6gw" podStartSLOduration=2.425577906 podStartE2EDuration="4.354101304s" totalImagesPullingTime="1.928523398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:49:02.354089299 +0000 UTC m=+38.682629007" watchObservedRunningTime="2026-06-06 13:49:02.354101304 +0000 UTC m=+38.682640972" Jun 06 13:49:06.276763 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:06.276711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:49:06.277214 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:06.276835 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:49:06.277214 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:06.276899 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:49:14.276885417 +0000 UTC m=+50.605425062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:49:14.333390 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:14.333348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:49:14.333920 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:14.333497 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:49:14.333920 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:14.333561 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:49:30.333544646 +0000 UTC m=+66.662084292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:49:23.293858 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:23.293822 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wdgxr" Jun 06 13:49:29.843948 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.843898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:49:29.846813 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.846786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 13:49:29.858220 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.858190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1007746-5164-438c-ad0e-eb5d1ab2d351-original-pull-secret\") pod \"global-pull-secret-syncer-h9f4q\" (UID: \"e1007746-5164-438c-ad0e-eb5d1ab2d351\") " pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:49:29.944950 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.944890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:49:29.944950 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.944948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:49:29.947812 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.947795 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 13:49:29.947876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.947796 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 13:49:29.955778 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:29.955757 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 13:49:29.955891 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:29.955826 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:50:33.955811295 +0000 UTC m=+130.284350944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : secret "metrics-daemon-secret" not found Jun 06 13:49:29.957752 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.957739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 13:49:29.968967 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:29.968946 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spp7b\" (UniqueName: \"kubernetes.io/projected/7189fe1d-9959-4244-a14f-8205ab4f1482-kube-api-access-spp7b\") pod \"network-check-target-cjwh8\" (UID: \"7189fe1d-9959-4244-a14f-8205ab4f1482\") " pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:49:30.146568 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.146541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb9zz\"" Jun 06 13:49:30.150464 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.150450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9f4q" Jun 06 13:49:30.154611 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.154585 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:49:30.299878 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.299845 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cjwh8"] Jun 06 13:49:30.304201 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:49:30.304165 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7189fe1d_9959_4244_a14f_8205ab4f1482.slice/crio-bbf2ded488928f25e0d7e02b59f46a44804dd46aaa49eb4f299464a2d30fa0e3 WatchSource:0}: Error finding container bbf2ded488928f25e0d7e02b59f46a44804dd46aaa49eb4f299464a2d30fa0e3: Status 404 returned error can't find the container with id bbf2ded488928f25e0d7e02b59f46a44804dd46aaa49eb4f299464a2d30fa0e3 Jun 06 13:49:30.315053 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.315013 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9f4q"] Jun 06 13:49:30.318378 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:49:30.318355 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1007746_5164_438c_ad0e_eb5d1ab2d351.slice/crio-368daa2dfedd93560780c6dcfe4489c1849e40112eb45c8ee8156606cc185c96 WatchSource:0}: Error finding container 368daa2dfedd93560780c6dcfe4489c1849e40112eb45c8ee8156606cc185c96: Status 404 returned error can't find the container with id 368daa2dfedd93560780c6dcfe4489c1849e40112eb45c8ee8156606cc185c96 Jun 06 13:49:30.348478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.348440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:49:30.348630 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:30.348598 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:49:30.348697 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:49:30.348686 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:50:02.348670584 +0000 UTC m=+98.677210234 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:49:30.383420 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.383384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9f4q" event={"ID":"e1007746-5164-438c-ad0e-eb5d1ab2d351","Type":"ContainerStarted","Data":"368daa2dfedd93560780c6dcfe4489c1849e40112eb45c8ee8156606cc185c96"} Jun 06 13:49:30.384312 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:30.384291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjwh8" event={"ID":"7189fe1d-9959-4244-a14f-8205ab4f1482","Type":"ContainerStarted","Data":"bbf2ded488928f25e0d7e02b59f46a44804dd46aaa49eb4f299464a2d30fa0e3"} Jun 06 13:49:35.402730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:35.402681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cjwh8" event={"ID":"7189fe1d-9959-4244-a14f-8205ab4f1482","Type":"ContainerStarted","Data":"3847588ac829b6b11819fb6e824aa224cda5aaa95773be901afc80597890c3ff"} Jun 06 13:49:35.403186 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:35.402782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:49:35.403909 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:35.403885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9f4q" event={"ID":"e1007746-5164-438c-ad0e-eb5d1ab2d351","Type":"ContainerStarted","Data":"2863e19fe57878839266acd26dfc69af35fc8909c567ccca9b23326126ececde"} Jun 06 13:49:35.417432 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:35.417387 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cjwh8" podStartSLOduration=67.180051175 podStartE2EDuration="1m11.417370318s" totalImagesPullingTime="4.237319143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:49:35.416728194 +0000 UTC m=+71.745267862" watchObservedRunningTime="2026-06-06 13:49:35.417370318 +0000 UTC m=+71.745910039" Jun 06 13:49:35.429832 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:49:35.429782 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h9f4q" podStartSLOduration=67.202864425 podStartE2EDuration="1m11.429770653s" totalImagesPullingTime="4.226906228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:49:35.428846599 +0000 UTC m=+71.757386266" watchObservedRunningTime="2026-06-06 13:49:35.429770653 +0000 UTC m=+71.758310320" Jun 06 13:50:02.363678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:50:02.363643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:50:02.364097 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:50:02.363806 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:50:02.364097 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:50:02.363883 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:51:06.363865037 +0000 UTC m=+162.692404682 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:50:06.409056 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:50:06.409010 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cjwh8" Jun 06 13:50:33.968945 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:50:33.968758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:50:33.969589 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:50:33.969353 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 13:50:33.969589 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:50:33.969438 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs podName:9299878a-be24-4725-a280-d9714a5b4ab4 nodeName:}" failed. No retries permitted until 2026-06-06 13:52:35.969415453 +0000 UTC m=+252.297955119 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs") pod "network-metrics-daemon-sbklr" (UID: "9299878a-be24-4725-a280-d9714a5b4ab4") : secret "metrics-daemon-secret" not found Jun 06 13:51:01.523714 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:01.523649 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9jfsf" podUID="23c2a91d-1644-406e-b1b1-8bd9545d4f7b" Jun 06 13:51:01.608633 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:01.608607 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9jfsf" Jun 06 13:51:03.156615 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:03.156562 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sbklr" podUID="9299878a-be24-4725-a280-d9714a5b4ab4" Jun 06 13:51:06.382246 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:06.382210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:51:06.382648 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:06.382324 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:51:06.382648 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:06.382375 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls podName:23c2a91d-1644-406e-b1b1-8bd9545d4f7b nodeName:}" failed. No retries permitted until 2026-06-06 13:53:08.382362537 +0000 UTC m=+284.710902183 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls") pod "dns-default-9jfsf" (UID: "23c2a91d-1644-406e-b1b1-8bd9545d4f7b") : secret "dns-default-metrics-tls" not found Jun 06 13:51:15.132690 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:15.132583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:51:24.571963 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.571927 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf"] Jun 06 13:51:24.573658 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.573638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" Jun 06 13:51:24.575947 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.575926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:51:24.576078 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.575997 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 06 13:51:24.577374 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.577351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-65gdd\"" Jun 06 13:51:24.578185 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.578163 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9d9fc48c-xpkpp"] Jun 06 13:51:24.580052 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.580032 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-gv8ss"] Jun 06 13:51:24.580138 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.580127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.581964 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.581949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.582518 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.582497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4fztn\"" Jun 06 13:51:24.582597 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.582525 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 06 13:51:24.582757 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.582734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 13:51:24.582860 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.582785 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 06 13:51:24.582860 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.582798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 13:51:24.582860 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.582791 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 06 13:51:24.582860 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.582842 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 06 13:51:24.584337 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.584318 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 13:51:24.584780 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.584760 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 13:51:24.585387 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.585369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 06 13:51:24.585550 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.585381 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 06 13:51:24.585651 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.585397 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zlh8r\"" Jun 06 13:51:24.585939 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.585921 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf"] Jun 06 13:51:24.589768 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.589746 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 06 13:51:24.597677 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.597657 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-gv8ss"] Jun 06 13:51:24.598351 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.598329 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9d9fc48c-xpkpp"] Jun 06 13:51:24.675430 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.675395 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5"] Jun 06 13:51:24.677542 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.677524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.680142 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.680121 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 06 13:51:24.680265 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.680124 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:51:24.680265 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.680216 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lr47g\"" Jun 06 13:51:24.680489 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.680474 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 06 13:51:24.680554 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.680541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 06 13:51:24.687116 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.687097 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5"] Jun 06 13:51:24.703524 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.703639 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d9cbaff-2630-46d9-b6da-971c9ed8430a-tmp\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.703639 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d9cbaff-2630-46d9-b6da-971c9ed8430a-serving-cert\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.703639 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-default-certificate\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.703751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d9cbaff-2630-46d9-b6da-971c9ed8430a-snapshots\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.703751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-stats-auth\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.703751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2d72\" (UniqueName: \"kubernetes.io/projected/71bc42da-b610-4f10-97ab-d21003702a8d-kube-api-access-v2d72\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.703751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9cbaff-2630-46d9-b6da-971c9ed8430a-service-ca-bundle\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.703888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.703888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9cbaff-2630-46d9-b6da-971c9ed8430a-trusted-ca-bundle\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.703888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dm74\" (UniqueName: \"kubernetes.io/projected/9d9cbaff-2630-46d9-b6da-971c9ed8430a-kube-api-access-9dm74\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.703888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.703855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrk6\" (UniqueName: \"kubernetes.io/projected/5e03bab1-6a6d-4636-8c40-33e202bdf487-kube-api-access-wqrk6\") pod \"volume-data-source-validator-78dd696465-ws4cf\" (UID: \"5e03bab1-6a6d-4636-8c40-33e202bdf487\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" Jun 06 13:51:24.768891 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.768856 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn"] Jun 06 13:51:24.770767 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.770751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:24.773193 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.773164 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 06 13:51:24.773316 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.773208 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 06 13:51:24.773387 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.773356 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:51:24.773451 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.773415 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dvs2v\"" Jun 06 13:51:24.780707 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.780687 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn"] Jun 06 13:51:24.804678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.804811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d9cbaff-2630-46d9-b6da-971c9ed8430a-tmp\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.804811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d9cbaff-2630-46d9-b6da-971c9ed8430a-serving-cert\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.804811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-default-certificate\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.804977 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:24.804818 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:51:24.804977 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a99adcd-7a55-4f84-81f6-6e5be45b7879-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.804977 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:24.804900 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:25.304878446 +0000 UTC m=+181.633418105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : secret "router-metrics-certs-default" not found Jun 06 13:51:24.804977 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d9cbaff-2630-46d9-b6da-971c9ed8430a-snapshots\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.804977 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a99adcd-7a55-4f84-81f6-6e5be45b7879-config\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.805254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.804982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv9d5\" (UniqueName: \"kubernetes.io/projected/9a99adcd-7a55-4f84-81f6-6e5be45b7879-kube-api-access-qv9d5\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.805254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805039 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d9cbaff-2630-46d9-b6da-971c9ed8430a-tmp\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.805254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-stats-auth\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.805254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2d72\" (UniqueName: \"kubernetes.io/projected/71bc42da-b610-4f10-97ab-d21003702a8d-kube-api-access-v2d72\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.805254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9cbaff-2630-46d9-b6da-971c9ed8430a-service-ca-bundle\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.805254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.805254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9cbaff-2630-46d9-b6da-971c9ed8430a-trusted-ca-bundle\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.805588 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:24.805290 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:25.30527379 +0000 UTC m=+181.633813435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : configmap references non-existent config key: service-ca.crt Jun 06 13:51:24.805588 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dm74\" (UniqueName: \"kubernetes.io/projected/9d9cbaff-2630-46d9-b6da-971c9ed8430a-kube-api-access-9dm74\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.805588 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d9cbaff-2630-46d9-b6da-971c9ed8430a-snapshots\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.805588 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrk6\" (UniqueName: \"kubernetes.io/projected/5e03bab1-6a6d-4636-8c40-33e202bdf487-kube-api-access-wqrk6\") pod \"volume-data-source-validator-78dd696465-ws4cf\" (UID: \"5e03bab1-6a6d-4636-8c40-33e202bdf487\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" Jun 06 13:51:24.805731 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9cbaff-2630-46d9-b6da-971c9ed8430a-service-ca-bundle\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.805930 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.805912 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9cbaff-2630-46d9-b6da-971c9ed8430a-trusted-ca-bundle\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.807563 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.807532 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-stats-auth\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.807675 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.807533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d9cbaff-2630-46d9-b6da-971c9ed8430a-serving-cert\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.807675 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.807642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-default-certificate\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.813066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.813042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrk6\" (UniqueName: \"kubernetes.io/projected/5e03bab1-6a6d-4636-8c40-33e202bdf487-kube-api-access-wqrk6\") pod \"volume-data-source-validator-78dd696465-ws4cf\" (UID: \"5e03bab1-6a6d-4636-8c40-33e202bdf487\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" Jun 06 13:51:24.813185 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.813119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dm74\" (UniqueName: \"kubernetes.io/projected/9d9cbaff-2630-46d9-b6da-971c9ed8430a-kube-api-access-9dm74\") pod \"insights-operator-896549976-gv8ss\" (UID: \"9d9cbaff-2630-46d9-b6da-971c9ed8430a\") " pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.813301 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.813285 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2d72\" (UniqueName: \"kubernetes.io/projected/71bc42da-b610-4f10-97ab-d21003702a8d-kube-api-access-v2d72\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:24.883825 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.883796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" Jun 06 13:51:24.898354 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.898326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-gv8ss" Jun 06 13:51:24.906851 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.906823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a99adcd-7a55-4f84-81f6-6e5be45b7879-config\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.906987 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.906864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv9d5\" (UniqueName: \"kubernetes.io/projected/9a99adcd-7a55-4f84-81f6-6e5be45b7879-kube-api-access-qv9d5\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.906987 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.906924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:24.907124 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.907061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f77r\" (UniqueName: \"kubernetes.io/projected/38c2d34d-f427-4729-845d-09e2bb291366-kube-api-access-7f77r\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:24.907124 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.907115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a99adcd-7a55-4f84-81f6-6e5be45b7879-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.907458 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.907437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a99adcd-7a55-4f84-81f6-6e5be45b7879-config\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.909427 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.909396 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a99adcd-7a55-4f84-81f6-6e5be45b7879-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.914043 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.913995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv9d5\" (UniqueName: \"kubernetes.io/projected/9a99adcd-7a55-4f84-81f6-6e5be45b7879-kube-api-access-qv9d5\") pod \"service-ca-operator-6bc5ff68f5-mmqh5\" (UID: \"9a99adcd-7a55-4f84-81f6-6e5be45b7879\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:24.987817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:24.986907 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" Jun 06 13:51:25.008191 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.008126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:25.008191 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.008190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f77r\" (UniqueName: \"kubernetes.io/projected/38c2d34d-f427-4729-845d-09e2bb291366-kube-api-access-7f77r\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:25.008347 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:25.008249 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:51:25.008347 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:25.008333 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls podName:38c2d34d-f427-4729-845d-09e2bb291366 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:25.508312678 +0000 UTC m=+181.836852337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vn4nn" (UID: "38c2d34d-f427-4729-845d-09e2bb291366") : secret "samples-operator-tls" not found Jun 06 13:51:25.014283 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.014250 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf"] Jun 06 13:51:25.017568 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:25.017512 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e03bab1_6a6d_4636_8c40_33e202bdf487.slice/crio-ef6fe536840e2d01af2dfc3faad05fbe8f70c6395001062708dd3014955df18e WatchSource:0}: Error finding container ef6fe536840e2d01af2dfc3faad05fbe8f70c6395001062708dd3014955df18e: Status 404 returned error can't find the container with id ef6fe536840e2d01af2dfc3faad05fbe8f70c6395001062708dd3014955df18e Jun 06 13:51:25.018039 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.017966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f77r\" (UniqueName: \"kubernetes.io/projected/38c2d34d-f427-4729-845d-09e2bb291366-kube-api-access-7f77r\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:25.034784 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.034759 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-gv8ss"] Jun 06 13:51:25.038905 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:25.038869 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9cbaff_2630_46d9_b6da_971c9ed8430a.slice/crio-e142098f5a9deb71e0347001aae7759fbc3cfdd19232a2579265a506e9129bc3 WatchSource:0}: Error finding container e142098f5a9deb71e0347001aae7759fbc3cfdd19232a2579265a506e9129bc3: Status 404 returned error can't find the container with id e142098f5a9deb71e0347001aae7759fbc3cfdd19232a2579265a506e9129bc3 Jun 06 13:51:25.110700 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.110668 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5"] Jun 06 13:51:25.113474 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:25.113445 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a99adcd_7a55_4f84_81f6_6e5be45b7879.slice/crio-1425150b9db4e333999e6c627e5f3fbc1a9ae4897923f183c2d1f91e8d501bbf WatchSource:0}: Error finding container 1425150b9db4e333999e6c627e5f3fbc1a9ae4897923f183c2d1f91e8d501bbf: Status 404 returned error can't find the container with id 1425150b9db4e333999e6c627e5f3fbc1a9ae4897923f183c2d1f91e8d501bbf Jun 06 13:51:25.309661 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.309579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:25.309661 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.309630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:25.309850 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:25.309741 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:26.309723673 +0000 UTC m=+182.638263317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : configmap references non-existent config key: service-ca.crt Jun 06 13:51:25.309850 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:25.309761 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:51:25.309850 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:25.309800 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:26.309788428 +0000 UTC m=+182.638328072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : secret "router-metrics-certs-default" not found Jun 06 13:51:25.511292 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.511255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:25.511491 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:25.511421 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:51:25.511561 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:25.511496 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls podName:38c2d34d-f427-4729-845d-09e2bb291366 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:26.511476337 +0000 UTC m=+182.840015995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vn4nn" (UID: "38c2d34d-f427-4729-845d-09e2bb291366") : secret "samples-operator-tls" not found Jun 06 13:51:25.670039 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.669916 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" event={"ID":"9a99adcd-7a55-4f84-81f6-6e5be45b7879","Type":"ContainerStarted","Data":"1425150b9db4e333999e6c627e5f3fbc1a9ae4897923f183c2d1f91e8d501bbf"} Jun 06 13:51:25.671632 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.671600 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" event={"ID":"5e03bab1-6a6d-4636-8c40-33e202bdf487","Type":"ContainerStarted","Data":"ef6fe536840e2d01af2dfc3faad05fbe8f70c6395001062708dd3014955df18e"} Jun 06 13:51:25.673172 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:25.673149 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gv8ss" event={"ID":"9d9cbaff-2630-46d9-b6da-971c9ed8430a","Type":"ContainerStarted","Data":"e142098f5a9deb71e0347001aae7759fbc3cfdd19232a2579265a506e9129bc3"} Jun 06 13:51:26.317851 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:26.317800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:26.318065 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:26.317900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:26.318065 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:26.317957 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:51:26.318065 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:26.318059 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:28.318038343 +0000 UTC m=+184.646578006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : secret "router-metrics-certs-default" not found Jun 06 13:51:26.318256 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:26.318079 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:28.318069821 +0000 UTC m=+184.646609466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : configmap references non-existent config key: service-ca.crt Jun 06 13:51:26.519852 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:26.519760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:26.520005 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:26.519916 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:51:26.520005 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:26.519987 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls podName:38c2d34d-f427-4729-845d-09e2bb291366 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:28.519967514 +0000 UTC m=+184.848507165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vn4nn" (UID: "38c2d34d-f427-4729-845d-09e2bb291366") : secret "samples-operator-tls" not found Jun 06 13:51:26.678232 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:26.678197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" event={"ID":"5e03bab1-6a6d-4636-8c40-33e202bdf487","Type":"ContainerStarted","Data":"971ee76b7bf574a330fd25483c0d2216afbfa06aba47b9157519e56dbbf9d020"} Jun 06 13:51:26.693779 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:26.693720 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-ws4cf" podStartSLOduration=1.530840121 podStartE2EDuration="2.693703589s" totalImagesPullingTime="1.162863468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:26.693060166 +0000 UTC m=+183.021599834" watchObservedRunningTime="2026-06-06 13:51:26.693703589 +0000 UTC m=+183.022243256" Jun 06 13:51:27.683851 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:27.683800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" event={"ID":"9a99adcd-7a55-4f84-81f6-6e5be45b7879","Type":"ContainerStarted","Data":"cf6571da973e42fa26679126d17621b24e6ff4d2cbadc883a75d9f37c7265728"} Jun 06 13:51:27.685549 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:27.685523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gv8ss" event={"ID":"9d9cbaff-2630-46d9-b6da-971c9ed8430a","Type":"ContainerStarted","Data":"591e4421a99872dc54981787c7cd60caa94d434ca3988b74f6a2f31ebc0b4d90"} Jun 06 13:51:27.698887 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:27.698843 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" podStartSLOduration=1.253228757 podStartE2EDuration="3.698823491s" totalImagesPullingTime="2.445594734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:27.697897778 +0000 UTC m=+184.026437446" watchObservedRunningTime="2026-06-06 13:51:27.698823491 +0000 UTC m=+184.027363158" Jun 06 13:51:27.715066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:27.714997 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-gv8ss" podStartSLOduration=1.193551576 podStartE2EDuration="3.714977216s" totalImagesPullingTime="2.52142564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:27.713723812 +0000 UTC m=+184.042263480" watchObservedRunningTime="2026-06-06 13:51:27.714977216 +0000 UTC m=+184.043516884" Jun 06 13:51:28.337386 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:28.337339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:28.337582 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:28.337424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:28.337582 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:28.337531 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:51:28.337582 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:28.337554 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:32.337530607 +0000 UTC m=+188.666070264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : configmap references non-existent config key: service-ca.crt Jun 06 13:51:28.337582 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:28.337583 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:32.337572621 +0000 UTC m=+188.666112266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : secret "router-metrics-certs-default" not found Jun 06 13:51:28.539336 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:28.539291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:28.539537 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:28.539479 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:51:28.539599 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:28.539564 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls podName:38c2d34d-f427-4729-845d-09e2bb291366 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:32.539541928 +0000 UTC m=+188.868081576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vn4nn" (UID: "38c2d34d-f427-4729-845d-09e2bb291366") : secret "samples-operator-tls" not found Jun 06 13:51:31.133743 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.133710 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z8h9z"] Jun 06 13:51:31.137788 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.137768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.140430 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.140401 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zwxp6\"" Jun 06 13:51:31.140544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.140430 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 06 13:51:31.140544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.140493 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 06 13:51:31.140544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.140495 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 06 13:51:31.141550 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.141533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 06 13:51:31.145263 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.145243 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z8h9z"] Jun 06 13:51:31.262615 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.262587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f2337b64-20c4-411a-b0de-d948c139bff9-signing-key\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.262784 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.262652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k6xm\" (UniqueName: \"kubernetes.io/projected/f2337b64-20c4-411a-b0de-d948c139bff9-kube-api-access-7k6xm\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.262784 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.262713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f2337b64-20c4-411a-b0de-d948c139bff9-signing-cabundle\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.363915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.363881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f2337b64-20c4-411a-b0de-d948c139bff9-signing-key\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.364147 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.363951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k6xm\" (UniqueName: \"kubernetes.io/projected/f2337b64-20c4-411a-b0de-d948c139bff9-kube-api-access-7k6xm\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.364147 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.363993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f2337b64-20c4-411a-b0de-d948c139bff9-signing-cabundle\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.364679 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.364660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f2337b64-20c4-411a-b0de-d948c139bff9-signing-cabundle\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.366259 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.366231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f2337b64-20c4-411a-b0de-d948c139bff9-signing-key\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.371935 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.371910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k6xm\" (UniqueName: \"kubernetes.io/projected/f2337b64-20c4-411a-b0de-d948c139bff9-kube-api-access-7k6xm\") pod \"service-ca-7d74d578b8-z8h9z\" (UID: \"f2337b64-20c4-411a-b0de-d948c139bff9\") " pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.447080 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.446980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" Jun 06 13:51:31.564729 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.564695 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z8h9z"] Jun 06 13:51:31.567915 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:31.567893 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2337b64_20c4_411a_b0de_d948c139bff9.slice/crio-8b9f4be1785bbbf18f99115917ce4607c7c63eaa2ced6c251009991a382d0e08 WatchSource:0}: Error finding container 8b9f4be1785bbbf18f99115917ce4607c7c63eaa2ced6c251009991a382d0e08: Status 404 returned error can't find the container with id 8b9f4be1785bbbf18f99115917ce4607c7c63eaa2ced6c251009991a382d0e08 Jun 06 13:51:31.699280 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.699194 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" event={"ID":"f2337b64-20c4-411a-b0de-d948c139bff9","Type":"ContainerStarted","Data":"0f8f30bee6bf06ece70d965d4ea82f9ff16bc3ef00e2ebf2382300c3e76c7bd6"} Jun 06 13:51:31.699280 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.699247 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" event={"ID":"f2337b64-20c4-411a-b0de-d948c139bff9","Type":"ContainerStarted","Data":"8b9f4be1785bbbf18f99115917ce4607c7c63eaa2ced6c251009991a382d0e08"} Jun 06 13:51:31.718243 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:31.718192 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-z8h9z" podStartSLOduration=0.718174644 podStartE2EDuration="718.174644ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:31.717086347 +0000 UTC m=+188.045626013" watchObservedRunningTime="2026-06-06 13:51:31.718174644 +0000 UTC m=+188.046714355" Jun 06 13:51:32.319789 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:32.319759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vvtkr_b214ff39-d422-4f07-9180-798938c62cbd/dns-node-resolver/0.log" Jun 06 13:51:32.372097 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:32.372066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:32.372245 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:32.372120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:32.372245 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:32.372216 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:51:32.372349 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:32.372255 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:40.372229999 +0000 UTC m=+196.700769645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : configmap references non-existent config key: service-ca.crt Jun 06 13:51:32.372349 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:32.372316 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs podName:71bc42da-b610-4f10-97ab-d21003702a8d nodeName:}" failed. No retries permitted until 2026-06-06 13:51:40.372297067 +0000 UTC m=+196.700836712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs") pod "router-default-9d9fc48c-xpkpp" (UID: "71bc42da-b610-4f10-97ab-d21003702a8d") : secret "router-metrics-certs-default" not found Jun 06 13:51:32.574374 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:32.574286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:32.574522 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:32.574450 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 06 13:51:32.574522 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:32.574513 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls podName:38c2d34d-f427-4729-845d-09e2bb291366 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:40.574498349 +0000 UTC m=+196.903037994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vn4nn" (UID: "38c2d34d-f427-4729-845d-09e2bb291366") : secret "samples-operator-tls" not found Jun 06 13:51:33.530617 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:33.530586 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rswsp_8e54b170-c19f-43b1-b4ee-dc50595328ee/node-ca/0.log" Jun 06 13:51:34.120368 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:34.120343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hd6gw_9bfa30a8-3e12-4903-a2c5-953bea0cecdc/serve-healthcheck-canary/0.log" Jun 06 13:51:40.440803 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.440769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:40.441320 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.440817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:40.441476 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.441455 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bc42da-b610-4f10-97ab-d21003702a8d-service-ca-bundle\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:40.443085 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.443067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71bc42da-b610-4f10-97ab-d21003702a8d-metrics-certs\") pod \"router-default-9d9fc48c-xpkpp\" (UID: \"71bc42da-b610-4f10-97ab-d21003702a8d\") " pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:40.492975 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.492946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:40.642581 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.642558 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9d9fc48c-xpkpp"] Jun 06 13:51:40.642720 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.642693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:40.645038 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.645006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38c2d34d-f427-4729-845d-09e2bb291366-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vn4nn\" (UID: \"38c2d34d-f427-4729-845d-09e2bb291366\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:40.645169 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:40.645063 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bc42da_b610_4f10_97ab_d21003702a8d.slice/crio-28dc4411efc876cacf1d13d3baaabe1848d5a7f0750a5b20a13de7bcff951f3c WatchSource:0}: Error finding container 28dc4411efc876cacf1d13d3baaabe1848d5a7f0750a5b20a13de7bcff951f3c: Status 404 returned error can't find the container with id 28dc4411efc876cacf1d13d3baaabe1848d5a7f0750a5b20a13de7bcff951f3c Jun 06 13:51:40.679221 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.679196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" Jun 06 13:51:40.729388 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.729348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" event={"ID":"71bc42da-b610-4f10-97ab-d21003702a8d","Type":"ContainerStarted","Data":"95b0d427578a9bf16932930f0743b4fc65bcc6b1209ae178a42c0f988a329915"} Jun 06 13:51:40.729544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.729410 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" event={"ID":"71bc42da-b610-4f10-97ab-d21003702a8d","Type":"ContainerStarted","Data":"28dc4411efc876cacf1d13d3baaabe1848d5a7f0750a5b20a13de7bcff951f3c"} Jun 06 13:51:40.748386 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.748337 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" podStartSLOduration=16.748321102 podStartE2EDuration="16.748321102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:40.747793909 +0000 UTC m=+197.076333577" watchObservedRunningTime="2026-06-06 13:51:40.748321102 +0000 UTC m=+197.076860768" Jun 06 13:51:40.811936 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:40.811901 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn"] Jun 06 13:51:41.493975 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:41.493939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:41.497124 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:41.497101 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:41.734629 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:41.734574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" event={"ID":"38c2d34d-f427-4729-845d-09e2bb291366","Type":"ContainerStarted","Data":"4ecb771cdc0bfa056a77c0cf18d570486c06195e827ba400fceb369837565dee"} Jun 06 13:51:41.734956 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:41.734928 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:41.736710 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:41.736687 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9d9fc48c-xpkpp" Jun 06 13:51:42.739241 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:42.739139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" event={"ID":"38c2d34d-f427-4729-845d-09e2bb291366","Type":"ContainerStarted","Data":"3528f07747e511530ea0b22b63360f2ef780f8e1bdf464470a727087a346e7a8"} Jun 06 13:51:42.739241 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:42.739210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" event={"ID":"38c2d34d-f427-4729-845d-09e2bb291366","Type":"ContainerStarted","Data":"27cb81187bac5a80559596999ca9ef664171e3a160f1e2da1d81468e35069c6e"} Jun 06 13:51:42.755251 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:42.755206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vn4nn" podStartSLOduration=17.178503849 podStartE2EDuration="18.755190645s" totalImagesPullingTime="1.576686796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:42.75375522 +0000 UTC m=+199.082294888" watchObservedRunningTime="2026-06-06 13:51:42.755190645 +0000 UTC m=+199.083730312" Jun 06 13:51:49.382228 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.382196 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn"] Jun 06 13:51:49.386612 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.386583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" Jun 06 13:51:49.389433 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.389411 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5k5bf"] Jun 06 13:51:49.390279 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.390258 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kzkfg\"" Jun 06 13:51:49.390422 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.390340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 06 13:51:49.392569 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.392553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.394983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.394963 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 13:51:49.395484 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.395303 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 13:51:49.395594 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.395482 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn"] Jun 06 13:51:49.396208 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.396011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jwxcz\"" Jun 06 13:51:49.403655 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.403629 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5k5bf"] Jun 06 13:51:49.409155 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.409130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ddwkn\" (UID: \"51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" Jun 06 13:51:49.510471 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.510435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-data-volume\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.510652 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.510474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmq6t\" (UniqueName: \"kubernetes.io/projected/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-kube-api-access-jmq6t\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.510652 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.510504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-crio-socket\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.510652 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.510602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.510652 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.510634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.510921 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.510746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ddwkn\" (UID: \"51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" Jun 06 13:51:49.513450 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.513422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ddwkn\" (UID: \"51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" Jun 06 13:51:49.612080 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-data-volume\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.612080 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmq6t\" (UniqueName: \"kubernetes.io/projected/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-kube-api-access-jmq6t\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.612319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-crio-socket\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.612319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.612319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.612319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612234 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-crio-socket\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.612509 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612415 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-data-volume\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.612717 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.612699 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.614565 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.614544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.620611 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.620590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmq6t\" (UniqueName: \"kubernetes.io/projected/ec86dc7d-03a0-4a01-9c7f-266cbb2e4478-kube-api-access-jmq6t\") pod \"insights-runtime-extractor-5k5bf\" (UID: \"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478\") " pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.699843 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.699765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" Jun 06 13:51:49.706977 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.706960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5k5bf" Jun 06 13:51:49.836573 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.836539 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn"] Jun 06 13:51:49.842444 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:49.842419 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c9e6e2_b6d5_4b0a_a3d9_423de48a39f8.slice/crio-712bd36bbb768ec762b16f91706b056ec8b7df9d6c98924985e65da4cbaa1650 WatchSource:0}: Error finding container 712bd36bbb768ec762b16f91706b056ec8b7df9d6c98924985e65da4cbaa1650: Status 404 returned error can't find the container with id 712bd36bbb768ec762b16f91706b056ec8b7df9d6c98924985e65da4cbaa1650 Jun 06 13:51:49.850644 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:49.850626 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5k5bf"] Jun 06 13:51:49.853440 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:49.853413 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec86dc7d_03a0_4a01_9c7f_266cbb2e4478.slice/crio-715f9d419025f326879c3e907860bc0a1ce82a40fb89e89a5b92e25d01e82c1d WatchSource:0}: Error finding container 715f9d419025f326879c3e907860bc0a1ce82a40fb89e89a5b92e25d01e82c1d: Status 404 returned error can't find the container with id 715f9d419025f326879c3e907860bc0a1ce82a40fb89e89a5b92e25d01e82c1d Jun 06 13:51:50.767992 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.767953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5k5bf" event={"ID":"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478","Type":"ContainerStarted","Data":"5e61f74f0f9e0524c414245b7b839136812f842dbf968e55c933b4d20206b365"} Jun 06 13:51:50.768463 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.768042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5k5bf" event={"ID":"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478","Type":"ContainerStarted","Data":"e4d705c07810e5792e033e575a9bad6e3d51b130fdac107d00bfe7686fb95c09"} Jun 06 13:51:50.768463 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.768072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5k5bf" event={"ID":"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478","Type":"ContainerStarted","Data":"715f9d419025f326879c3e907860bc0a1ce82a40fb89e89a5b92e25d01e82c1d"} Jun 06 13:51:50.769354 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.769321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" event={"ID":"51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8","Type":"ContainerStarted","Data":"712bd36bbb768ec762b16f91706b056ec8b7df9d6c98924985e65da4cbaa1650"} Jun 06 13:51:50.942099 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.942076 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-r4w6z"] Jun 06 13:51:50.944784 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.944764 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-r4w6z" Jun 06 13:51:50.947750 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.947359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 13:51:50.947750 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.947533 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 13:51:50.947750 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.947649 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5zvc5\"" Jun 06 13:51:50.955557 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:50.955532 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-r4w6z"] Jun 06 13:51:51.023833 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.023805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grdgt\" (UniqueName: \"kubernetes.io/projected/65a6f0ec-b650-426b-9d29-3b6fbb864e62-kube-api-access-grdgt\") pod \"downloads-6657875f97-r4w6z\" (UID: \"65a6f0ec-b650-426b-9d29-3b6fbb864e62\") " pod="openshift-console/downloads-6657875f97-r4w6z" Jun 06 13:51:51.124524 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.124489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grdgt\" (UniqueName: \"kubernetes.io/projected/65a6f0ec-b650-426b-9d29-3b6fbb864e62-kube-api-access-grdgt\") pod \"downloads-6657875f97-r4w6z\" (UID: \"65a6f0ec-b650-426b-9d29-3b6fbb864e62\") " pod="openshift-console/downloads-6657875f97-r4w6z" Jun 06 13:51:51.132690 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.132663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grdgt\" (UniqueName: \"kubernetes.io/projected/65a6f0ec-b650-426b-9d29-3b6fbb864e62-kube-api-access-grdgt\") pod \"downloads-6657875f97-r4w6z\" (UID: \"65a6f0ec-b650-426b-9d29-3b6fbb864e62\") " pod="openshift-console/downloads-6657875f97-r4w6z" Jun 06 13:51:51.255125 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.255042 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-r4w6z" Jun 06 13:51:51.396888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.396856 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-r4w6z"] Jun 06 13:51:51.400456 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:51.400425 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a6f0ec_b650_426b_9d29_3b6fbb864e62.slice/crio-b6ba5370302d54270a12b05e3a76dfc5d2f8006d002d26fc4505a795b0395d13 WatchSource:0}: Error finding container b6ba5370302d54270a12b05e3a76dfc5d2f8006d002d26fc4505a795b0395d13: Status 404 returned error can't find the container with id b6ba5370302d54270a12b05e3a76dfc5d2f8006d002d26fc4505a795b0395d13 Jun 06 13:51:51.773593 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.773557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-r4w6z" event={"ID":"65a6f0ec-b650-426b-9d29-3b6fbb864e62","Type":"ContainerStarted","Data":"b6ba5370302d54270a12b05e3a76dfc5d2f8006d002d26fc4505a795b0395d13"} Jun 06 13:51:51.775203 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.775168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" event={"ID":"51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8","Type":"ContainerStarted","Data":"02f00b6c79973048fba700b189d8ca25e5dfa3f8eee1dd1d8a3c02ff82684b58"} Jun 06 13:51:51.775413 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.775390 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" Jun 06 13:51:51.780659 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.780632 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" Jun 06 13:51:51.789168 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:51.789117 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ddwkn" podStartSLOduration=1.6950531880000002 podStartE2EDuration="2.789101025s" totalImagesPullingTime="1.094047837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:51.788988532 +0000 UTC m=+208.117528200" watchObservedRunningTime="2026-06-06 13:51:51.789101025 +0000 UTC m=+208.117640691" Jun 06 13:51:52.033924 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.033832 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq"] Jun 06 13:51:52.040855 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.040826 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.043467 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.043443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 13:51:52.043674 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.043572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 06 13:51:52.044409 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.044364 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 06 13:51:52.044585 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.044567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 13:51:52.044691 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.044612 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 13:51:52.044691 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.044619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5z5pl\"" Jun 06 13:51:52.047360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.047337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq"] Jun 06 13:51:52.133223 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.133190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6988888-0f46-4e15-8aa1-2ed15ce6d569-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.133390 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.133232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.133390 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.133251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnjrr\" (UniqueName: \"kubernetes.io/projected/e6988888-0f46-4e15-8aa1-2ed15ce6d569-kube-api-access-mnjrr\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.133390 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.133371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.234088 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.234050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6988888-0f46-4e15-8aa1-2ed15ce6d569-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.234217 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.234110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.234217 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.234139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnjrr\" (UniqueName: \"kubernetes.io/projected/e6988888-0f46-4e15-8aa1-2ed15ce6d569-kube-api-access-mnjrr\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.234217 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.234204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.234373 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:52.234253 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 06 13:51:52.234373 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:52.234319 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-tls podName:e6988888-0f46-4e15-8aa1-2ed15ce6d569 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:52.734301837 +0000 UTC m=+209.062841490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-9jzfq" (UID: "e6988888-0f46-4e15-8aa1-2ed15ce6d569") : secret "prometheus-operator-tls" not found Jun 06 13:51:52.234608 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.234586 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6988888-0f46-4e15-8aa1-2ed15ce6d569-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.236533 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.236509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.242322 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.242298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnjrr\" (UniqueName: \"kubernetes.io/projected/e6988888-0f46-4e15-8aa1-2ed15ce6d569-kube-api-access-mnjrr\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.738449 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.738412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.741087 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.741053 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6988888-0f46-4e15-8aa1-2ed15ce6d569-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9jzfq\" (UID: \"e6988888-0f46-4e15-8aa1-2ed15ce6d569\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:52.781419 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.781382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5k5bf" event={"ID":"ec86dc7d-03a0-4a01-9c7f-266cbb2e4478","Type":"ContainerStarted","Data":"9cca9809c86e5b802f6039997fdabe02caca791deb1b319fbdff53dee8f8dda3"} Jun 06 13:51:52.799067 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.798999 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5k5bf" podStartSLOduration=1.577296193 podStartE2EDuration="3.79898219s" totalImagesPullingTime="2.221685997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:51:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:52.798240641 +0000 UTC m=+209.126780308" watchObservedRunningTime="2026-06-06 13:51:52.79898219 +0000 UTC m=+209.127521857" Jun 06 13:51:52.952567 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:52.952526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" Jun 06 13:51:53.092753 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:53.092715 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq"] Jun 06 13:51:53.095839 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:53.095809 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6988888_0f46_4e15_8aa1_2ed15ce6d569.slice/crio-9bf708f1b61da583188e9fc161e9cc5b59c6a15b07027f0ba963022b004f5912 WatchSource:0}: Error finding container 9bf708f1b61da583188e9fc161e9cc5b59c6a15b07027f0ba963022b004f5912: Status 404 returned error can't find the container with id 9bf708f1b61da583188e9fc161e9cc5b59c6a15b07027f0ba963022b004f5912 Jun 06 13:51:53.787851 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:53.787529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" event={"ID":"e6988888-0f46-4e15-8aa1-2ed15ce6d569","Type":"ContainerStarted","Data":"9bf708f1b61da583188e9fc161e9cc5b59c6a15b07027f0ba963022b004f5912"} Jun 06 13:51:54.792751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:54.792659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" event={"ID":"e6988888-0f46-4e15-8aa1-2ed15ce6d569","Type":"ContainerStarted","Data":"9f23d3059c4af07299256b0293bd9e5672d9d99153bdb3e3cf8999180b1b69f5"} Jun 06 13:51:54.792751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:54.792719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" event={"ID":"e6988888-0f46-4e15-8aa1-2ed15ce6d569","Type":"ContainerStarted","Data":"ff373960c5ceacc82f0b1af7e5f577d9c5252089bb403c2598df1cbac52e9e22"} Jun 06 13:51:54.808113 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:54.808056 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9jzfq" podStartSLOduration=1.392133657 podStartE2EDuration="2.808014336s" totalImagesPullingTime="1.415880679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:54.807492721 +0000 UTC m=+211.136032389" watchObservedRunningTime="2026-06-06 13:51:54.808014336 +0000 UTC m=+211.136554005" Jun 06 13:51:56.384359 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.383657 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4"] Jun 06 13:51:56.387862 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.387812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.390387 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.390181 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 06 13:51:56.390387 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.390237 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5v6tm\"" Jun 06 13:51:56.391475 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.391455 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 06 13:51:56.391657 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.391582 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 06 13:51:56.399154 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.396881 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4"] Jun 06 13:51:56.401376 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.401015 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2zccv"] Jun 06 13:51:56.405239 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.404514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.407727 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.407517 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8rjb8\"" Jun 06 13:51:56.407727 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.407673 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 13:51:56.407895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.407752 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 13:51:56.407895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.407892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 13:51:56.475002 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.474956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-tls\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475183 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ee00d4cb-4514-454a-b1eb-e21b6a181d04-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.475183 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.475183 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4528j\" (UniqueName: \"kubernetes.io/projected/898fe78c-3563-4723-8123-b3c56d421bbd-kube-api-access-4528j\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475183 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-wtmp\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475183 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee00d4cb-4514-454a-b1eb-e21b6a181d04-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.475455 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9n9v\" (UniqueName: \"kubernetes.io/projected/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-api-access-x9n9v\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.475455 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475455 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/898fe78c-3563-4723-8123-b3c56d421bbd-metrics-client-ca\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475455 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.475455 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-sys\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475646 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-root\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475646 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.475646 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.475646 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.475613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-textfile\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.576924 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.576881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4528j\" (UniqueName: \"kubernetes.io/projected/898fe78c-3563-4723-8123-b3c56d421bbd-kube-api-access-4528j\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577133 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.576930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-wtmp\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577133 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.576963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee00d4cb-4514-454a-b1eb-e21b6a181d04-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.577133 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.576988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9n9v\" (UniqueName: \"kubernetes.io/projected/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-api-access-x9n9v\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.577133 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577133 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/898fe78c-3563-4723-8123-b3c56d421bbd-metrics-client-ca\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577133 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.577133 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-sys\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-root\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-wtmp\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-textfile\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-tls\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ee00d4cb-4514-454a-b1eb-e21b6a181d04-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.577689 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-sys\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.578180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/898fe78c-3563-4723-8123-b3c56d421bbd-metrics-client-ca\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.578180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.577896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/898fe78c-3563-4723-8123-b3c56d421bbd-root\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.578180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.578158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee00d4cb-4514-454a-b1eb-e21b6a181d04-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.578342 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.578158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.578342 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.578327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.578476 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.578453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ee00d4cb-4514-454a-b1eb-e21b6a181d04-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.578617 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.578574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-textfile\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.581006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.580693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.581006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.580754 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.581006 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.580962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/898fe78c-3563-4723-8123-b3c56d421bbd-node-exporter-tls\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.581226 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.581010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.586876 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.586830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4528j\" (UniqueName: \"kubernetes.io/projected/898fe78c-3563-4723-8123-b3c56d421bbd-kube-api-access-4528j\") pod \"node-exporter-2zccv\" (UID: \"898fe78c-3563-4723-8123-b3c56d421bbd\") " pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.587207 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.587184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9n9v\" (UniqueName: \"kubernetes.io/projected/ee00d4cb-4514-454a-b1eb-e21b6a181d04-kube-api-access-x9n9v\") pod \"kube-state-metrics-57bbf8bfb5-mchz4\" (UID: \"ee00d4cb-4514-454a-b1eb-e21b6a181d04\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.701890 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.701804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" Jun 06 13:51:56.718527 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.718495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2zccv" Jun 06 13:51:56.732075 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:56.732001 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898fe78c_3563_4723_8123_b3c56d421bbd.slice/crio-081d94b49e3473ae02350942530c1119289314c54baf973ea3f457ba673c8ef5 WatchSource:0}: Error finding container 081d94b49e3473ae02350942530c1119289314c54baf973ea3f457ba673c8ef5: Status 404 returned error can't find the container with id 081d94b49e3473ae02350942530c1119289314c54baf973ea3f457ba673c8ef5 Jun 06 13:51:56.805054 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.804917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zccv" event={"ID":"898fe78c-3563-4723-8123-b3c56d421bbd","Type":"ContainerStarted","Data":"081d94b49e3473ae02350942530c1119289314c54baf973ea3f457ba673c8ef5"} Jun 06 13:51:56.859357 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:56.859321 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4"] Jun 06 13:51:56.862348 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:56.862312 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee00d4cb_4514_454a_b1eb_e21b6a181d04.slice/crio-39634fc561842ddb5e8d0ee914e5de8d77fe657e37eaf4fe17bc5ee36c1e6d39 WatchSource:0}: Error finding container 39634fc561842ddb5e8d0ee914e5de8d77fe657e37eaf4fe17bc5ee36c1e6d39: Status 404 returned error can't find the container with id 39634fc561842ddb5e8d0ee914e5de8d77fe657e37eaf4fe17bc5ee36c1e6d39 Jun 06 13:51:57.437349 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.437134 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:51:57.441764 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.441414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.444245 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.444491 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.444614 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hlz5d\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.444724 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.444923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.444942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.445094 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.445212 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 13:51:57.445461 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.445267 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 13:51:57.446384 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.446361 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 13:51:57.454817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.454731 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.488754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.488807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.488874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.488902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-web-config\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.488927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.488958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-config-out\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.488979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.489010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489572 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.489090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxxgb\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-kube-api-access-fxxgb\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489572 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.489119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-config-volume\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489572 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.489155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489572 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.489279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.489572 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.489343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590331 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590331 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-web-config\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-config-out\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxxgb\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-kube-api-access-fxxgb\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-config-volume\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.590781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.590744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.591530 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:57.591408 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle podName:54ff83de-5896-408f-b592-9e5434596a83 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:58.091384633 +0000 UTC m=+214.419924297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "54ff83de-5896-408f-b592-9e5434596a83") : configmap references non-existent config key: ca-bundle.crt Jun 06 13:51:57.592134 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:57.592106 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 06 13:51:57.592251 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:51:57.592166 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls podName:54ff83de-5896-408f-b592-9e5434596a83 nodeName:}" failed. No retries permitted until 2026-06-06 13:51:58.092149924 +0000 UTC m=+214.420689585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "54ff83de-5896-408f-b592-9e5434596a83") : secret "alertmanager-main-tls" not found Jun 06 13:51:57.593811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.592842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.593811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.593759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.595294 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.595270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-config-out\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.595968 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.595947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.596402 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.596336 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.597275 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.597097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.598235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.597369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.598235 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.597776 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-config-volume\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.598866 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.598819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.599739 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.599701 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-web-config\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.602811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.602789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxxgb\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-kube-api-access-fxxgb\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:57.810749 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:57.810664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" event={"ID":"ee00d4cb-4514-454a-b1eb-e21b6a181d04","Type":"ContainerStarted","Data":"39634fc561842ddb5e8d0ee914e5de8d77fe657e37eaf4fe17bc5ee36c1e6d39"} Jun 06 13:51:58.096705 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.096368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:58.096705 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.096418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:58.097323 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.097290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:58.099156 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.099133 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:58.356308 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.356286 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:51:58.550214 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.550147 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:51:58.559433 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:58.559313 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ff83de_5896_408f_b592_9e5434596a83.slice/crio-503ce2bf62aa224b01c9a7a5f6dc6f40edf8fdb00bb4802739bd4bdb19684478 WatchSource:0}: Error finding container 503ce2bf62aa224b01c9a7a5f6dc6f40edf8fdb00bb4802739bd4bdb19684478: Status 404 returned error can't find the container with id 503ce2bf62aa224b01c9a7a5f6dc6f40edf8fdb00bb4802739bd4bdb19684478 Jun 06 13:51:58.820276 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.820237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerStarted","Data":"503ce2bf62aa224b01c9a7a5f6dc6f40edf8fdb00bb4802739bd4bdb19684478"} Jun 06 13:51:58.822167 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.822136 2578 generic.go:356] "Generic (PLEG): container finished" podID="898fe78c-3563-4723-8123-b3c56d421bbd" containerID="bab56dc7c207457d07b871fee9c6417ec7fc5d6c08fe72d0781e0cb28322c290" exitCode=0 Jun 06 13:51:58.822332 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.822231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zccv" event={"ID":"898fe78c-3563-4723-8123-b3c56d421bbd","Type":"ContainerDied","Data":"bab56dc7c207457d07b871fee9c6417ec7fc5d6c08fe72d0781e0cb28322c290"} Jun 06 13:51:58.824623 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.824594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" event={"ID":"ee00d4cb-4514-454a-b1eb-e21b6a181d04","Type":"ContainerStarted","Data":"9c2a83777ca89621f0aa648c6117036de1c2ffd059aa5bd84003b0e802a26f4c"} Jun 06 13:51:58.824747 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.824652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" event={"ID":"ee00d4cb-4514-454a-b1eb-e21b6a181d04","Type":"ContainerStarted","Data":"73c2241d41e1ff1d8359c042cbf1867b2ae5558d36de70fb532f139d001ba47c"} Jun 06 13:51:58.824747 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.824677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" event={"ID":"ee00d4cb-4514-454a-b1eb-e21b6a181d04","Type":"ContainerStarted","Data":"26a214902707b82bdb2a9d9f09292fe8640611468872fb232f5e52b6b1c36f93"} Jun 06 13:51:58.856041 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:58.855974 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-mchz4" podStartSLOduration=1.390656316 podStartE2EDuration="2.855953394s" totalImagesPullingTime="1.465297078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:58.855159016 +0000 UTC m=+215.183698708" watchObservedRunningTime="2026-06-06 13:51:58.855953394 +0000 UTC m=+215.184493064" Jun 06 13:51:59.358355 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.358185 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7fb58df84c-qvfg8"] Jun 06 13:51:59.362767 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.362740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.365615 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.365571 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 06 13:51:59.365779 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.365612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5bsu5mmsref3\"" Jun 06 13:51:59.365779 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.365671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 06 13:51:59.365779 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.365571 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 06 13:51:59.365779 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.365739 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rqbxp\"" Jun 06 13:51:59.366011 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.365933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 06 13:51:59.366912 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.366892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 06 13:51:59.373399 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.373313 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fb58df84c-qvfg8"] Jun 06 13:51:59.509330 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b3950f5-8bb5-43bd-9449-2b352730d7d2-metrics-client-ca\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.509517 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.509517 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.509517 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-tls\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.509706 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfrb8\" (UniqueName: \"kubernetes.io/projected/9b3950f5-8bb5-43bd-9449-2b352730d7d2-kube-api-access-cfrb8\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.509706 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.509706 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-grpc-tls\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.509706 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.509693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.610741 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.610741 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.610741 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-tls\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.611365 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfrb8\" (UniqueName: \"kubernetes.io/projected/9b3950f5-8bb5-43bd-9449-2b352730d7d2-kube-api-access-cfrb8\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.611365 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.611365 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-grpc-tls\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.611365 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.611365 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.610969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b3950f5-8bb5-43bd-9449-2b352730d7d2-metrics-client-ca\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.611744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.611716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b3950f5-8bb5-43bd-9449-2b352730d7d2-metrics-client-ca\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.617187 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.617128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.617328 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.617272 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-grpc-tls\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.617525 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.617497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.617581 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.617560 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.617675 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.617651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-tls\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.617825 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.617800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b3950f5-8bb5-43bd-9449-2b352730d7d2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.619716 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.619694 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfrb8\" (UniqueName: \"kubernetes.io/projected/9b3950f5-8bb5-43bd-9449-2b352730d7d2-kube-api-access-cfrb8\") pod \"thanos-querier-7fb58df84c-qvfg8\" (UID: \"9b3950f5-8bb5-43bd-9449-2b352730d7d2\") " pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.677115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.677088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:51:59.831435 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.831399 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7fb58df84c-qvfg8"] Jun 06 13:51:59.832351 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.832322 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zccv" event={"ID":"898fe78c-3563-4723-8123-b3c56d421bbd","Type":"ContainerStarted","Data":"bf872bb17cc5fd9dcf559b65c9667d1525951b4b5168eb466e21052294476ae6"} Jun 06 13:51:59.832481 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.832380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2zccv" event={"ID":"898fe78c-3563-4723-8123-b3c56d421bbd","Type":"ContainerStarted","Data":"25f2cce3cfd51189cc6830987c8e203e9917a67f0b5509b6e622973ed88ec1d8"} Jun 06 13:51:59.834297 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.834275 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ff83de-5896-408f-b592-9e5434596a83" containerID="9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15" exitCode=0 Jun 06 13:51:59.834392 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.834359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15"} Jun 06 13:51:59.838106 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:51:59.838079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3950f5_8bb5_43bd_9449_2b352730d7d2.slice/crio-e67e4dba70815461995f46d4f600e50281e8b4c76c262741e6f5e52aa7ad3ad9 WatchSource:0}: Error finding container e67e4dba70815461995f46d4f600e50281e8b4c76c262741e6f5e52aa7ad3ad9: Status 404 returned error can't find the container with id e67e4dba70815461995f46d4f600e50281e8b4c76c262741e6f5e52aa7ad3ad9 Jun 06 13:51:59.851534 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:51:59.851470 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2zccv" podStartSLOduration=2.6415963319999998 podStartE2EDuration="3.851448687s" totalImagesPullingTime="1.136127618s" totalInitContainerRuntime="73.724737ms" isStatefulPod=true podCreationTimestamp="2026-06-06 13:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:51:59.849746506 +0000 UTC m=+216.178286166" watchObservedRunningTime="2026-06-06 13:51:59.851448687 +0000 UTC m=+216.179988352" Jun 06 13:52:00.840815 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:00.840765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" event={"ID":"9b3950f5-8bb5-43bd-9449-2b352730d7d2","Type":"ContainerStarted","Data":"e67e4dba70815461995f46d4f600e50281e8b4c76c262741e6f5e52aa7ad3ad9"} Jun 06 13:52:01.567365 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.567335 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-87f54c966-x8wqr"] Jun 06 13:52:01.576531 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.576497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.580459 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.580429 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 06 13:52:01.580913 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.580887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 06 13:52:01.581163 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.581141 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 06 13:52:01.581163 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.580748 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 06 13:52:01.581306 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.580798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2h88l\"" Jun 06 13:52:01.582655 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.582612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 06 13:52:01.582863 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.582842 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-87f54c966-x8wqr"] Jun 06 13:52:01.588533 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.588508 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 06 13:52:01.734428 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.734624 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbvmr\" (UniqueName: \"kubernetes.io/projected/0aa09519-8f8f-47d3-91dd-fc4846275774-kube-api-access-nbvmr\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.734624 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-metrics-client-ca\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.734624 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-federate-client-tls\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.734745 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-serving-certs-ca-bundle\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.734745 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-secret-telemeter-client\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.734829 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-telemeter-client-tls\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.734829 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.734802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836158 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-federate-client-tls\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836303 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-serving-certs-ca-bundle\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836303 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-secret-telemeter-client\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836303 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-telemeter-client-tls\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836303 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836508 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836508 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbvmr\" (UniqueName: \"kubernetes.io/projected/0aa09519-8f8f-47d3-91dd-fc4846275774-kube-api-access-nbvmr\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.836508 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.836400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-metrics-client-ca\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.837237 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.837210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-metrics-client-ca\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.838921 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.838110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-serving-certs-ca-bundle\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.839310 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.839266 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa09519-8f8f-47d3-91dd-fc4846275774-telemeter-trusted-ca-bundle\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.839454 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.839420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-federate-client-tls\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.840617 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.840592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-telemeter-client-tls\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.841277 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.841096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.842744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.842720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0aa09519-8f8f-47d3-91dd-fc4846275774-secret-telemeter-client\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.847515 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.847496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbvmr\" (UniqueName: \"kubernetes.io/projected/0aa09519-8f8f-47d3-91dd-fc4846275774-kube-api-access-nbvmr\") pod \"telemeter-client-87f54c966-x8wqr\" (UID: \"0aa09519-8f8f-47d3-91dd-fc4846275774\") " pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:01.890428 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:01.890389 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" Jun 06 13:52:02.403566 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.401223 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-87f54c966-x8wqr"] Jun 06 13:52:02.409875 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:52:02.409824 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa09519_8f8f_47d3_91dd_fc4846275774.slice/crio-218b890b92e13c644fac30c4a12a50b12b7a6d1bb6b7c89fc02386216a3d914f WatchSource:0}: Error finding container 218b890b92e13c644fac30c4a12a50b12b7a6d1bb6b7c89fc02386216a3d914f: Status 404 returned error can't find the container with id 218b890b92e13c644fac30c4a12a50b12b7a6d1bb6b7c89fc02386216a3d914f Jun 06 13:52:02.640864 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.638438 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:52:02.644209 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.643258 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.647726 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.646495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 13:52:02.647726 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.646949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 13:52:02.647726 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.647178 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 13:52:02.647726 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.647338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 13:52:02.647726 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.647398 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 13:52:02.647726 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.647700 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 13:52:02.648588 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.648298 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 13:52:02.648588 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.648346 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 13:52:02.648588 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.648565 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 13:52:02.648794 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.648628 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 13:52:02.648794 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.648774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a6l9leua7en36\"" Jun 06 13:52:02.648888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.648802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4t4f\"" Jun 06 13:52:02.649081 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.649010 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 13:52:02.649282 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.649223 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 13:52:02.649738 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.649721 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 13:52:02.651984 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.651952 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 13:52:02.655309 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.655131 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 13:52:02.660670 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.660575 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:52:02.746888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.746792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.746888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.746838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.746888 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.746863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.746901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.746953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.746999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz8jm\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-kube-api-access-lz8jm\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.747604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.747523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848167 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.848610 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.849322 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.849322 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz8jm\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-kube-api-access-lz8jm\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.849322 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.849322 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.848758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.849322 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.849171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.849560 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.849370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.850644 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.850327 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.855118 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.855069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.855506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.855482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.855593 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.855551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.856823 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.856326 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.856823 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.856703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.858895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.858860 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.859847 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.859803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz8jm\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-kube-api-access-lz8jm\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.861131 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.860536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.861131 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.860692 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.861131 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.860736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.861131 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.860774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.861131 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.860877 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.861131 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.861057 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.861841 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.861816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.862233 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.862212 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.862691 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.862640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.863445 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.863425 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:02.864319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.863976 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerStarted","Data":"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174"} Jun 06 13:52:02.864319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.864150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerStarted","Data":"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b"} Jun 06 13:52:02.864319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.864192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerStarted","Data":"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b"} Jun 06 13:52:02.864319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.864230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerStarted","Data":"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9"} Jun 06 13:52:02.864319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.864264 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerStarted","Data":"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8"} Jun 06 13:52:02.869077 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.868654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" event={"ID":"9b3950f5-8bb5-43bd-9449-2b352730d7d2","Type":"ContainerStarted","Data":"71c800ef335dab46d38f96e73db40fb6f8ad20a069cf4ed16ce781bf6291a1dd"} Jun 06 13:52:02.869077 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.868825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" event={"ID":"9b3950f5-8bb5-43bd-9449-2b352730d7d2","Type":"ContainerStarted","Data":"b2b4521fa45c50abd627ecd45747ee06691c226117b8ebadae7d93a99956470b"} Jun 06 13:52:02.869077 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.868908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" event={"ID":"9b3950f5-8bb5-43bd-9449-2b352730d7d2","Type":"ContainerStarted","Data":"a866c7e3b1810929360fb79dc954ef8b9ee7696bed49e123ab49ca58296ac32d"} Jun 06 13:52:02.871139 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.870151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" event={"ID":"0aa09519-8f8f-47d3-91dd-fc4846275774","Type":"ContainerStarted","Data":"218b890b92e13c644fac30c4a12a50b12b7a6d1bb6b7c89fc02386216a3d914f"} Jun 06 13:52:02.958108 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:02.958051 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:10.478803 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.478777 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:52:10.479748 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:52:10.479720 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd674fa_0a5e_4f2d_8e53_d82598a3c1a6.slice/crio-9e7fa18ff6b1f6f25a201720ea974322926cbab516a1eaccf0a4ada01352116d WatchSource:0}: Error finding container 9e7fa18ff6b1f6f25a201720ea974322926cbab516a1eaccf0a4ada01352116d: Status 404 returned error can't find the container with id 9e7fa18ff6b1f6f25a201720ea974322926cbab516a1eaccf0a4ada01352116d Jun 06 13:52:10.913602 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.913569 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" event={"ID":"0aa09519-8f8f-47d3-91dd-fc4846275774","Type":"ContainerStarted","Data":"e86a0857f2f328e9841255f91550157f40f1cc2dcf8986795f0b4530c10a0dda"} Jun 06 13:52:10.913718 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.913643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" event={"ID":"0aa09519-8f8f-47d3-91dd-fc4846275774","Type":"ContainerStarted","Data":"067548f56f660912b8d64a8a18b05d8939667f65ac7cd1d48fbc674142e05357"} Jun 06 13:52:10.913718 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.913677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" event={"ID":"0aa09519-8f8f-47d3-91dd-fc4846275774","Type":"ContainerStarted","Data":"2082e04bc850cbed2c19c7f238f7da9e452cc83dda90ca3e3191bad78c86e853"} Jun 06 13:52:10.915817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.915789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-r4w6z" event={"ID":"65a6f0ec-b650-426b-9d29-3b6fbb864e62","Type":"ContainerStarted","Data":"5cf41a61de4c1ef1936f41777794b62375e3650b2141036a16697dbc8e2b86f9"} Jun 06 13:52:10.916194 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.916172 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-r4w6z" Jun 06 13:52:10.918533 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.918506 2578 generic.go:356] "Generic (PLEG): container finished" podID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerID="63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf" exitCode=0 Jun 06 13:52:10.918622 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.918587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf"} Jun 06 13:52:10.918678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.918645 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerStarted","Data":"9e7fa18ff6b1f6f25a201720ea974322926cbab516a1eaccf0a4ada01352116d"} Jun 06 13:52:10.934829 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.934654 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-87f54c966-x8wqr" podStartSLOduration=2.022293884 podStartE2EDuration="9.934633671s" totalImagesPullingTime="7.912339787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:52:10.933293212 +0000 UTC m=+227.261832893" watchObservedRunningTime="2026-06-06 13:52:10.934633671 +0000 UTC m=+227.263173341" Jun 06 13:52:10.934829 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.934712 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-r4w6z" Jun 06 13:52:10.948693 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:10.948647 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-r4w6z" podStartSLOduration=1.978768751 podStartE2EDuration="20.948629959s" totalImagesPullingTime="18.969861208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:52:10.947368502 +0000 UTC m=+227.275908170" watchObservedRunningTime="2026-06-06 13:52:10.948629959 +0000 UTC m=+227.277169646" Jun 06 13:52:11.932510 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:11.931243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerStarted","Data":"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30"} Jun 06 13:52:11.941736 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:11.941041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" event={"ID":"9b3950f5-8bb5-43bd-9449-2b352730d7d2","Type":"ContainerStarted","Data":"a5774d83edd3827d23f29e95ba0dbeb95f63ea1c7833c9635112e21b3201963d"} Jun 06 13:52:11.941736 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:11.941119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" event={"ID":"9b3950f5-8bb5-43bd-9449-2b352730d7d2","Type":"ContainerStarted","Data":"9e6c4798ee38b0a9a0c1fd2271b4ab08d5e1b7afc191e201d96f495f0ab15c85"} Jun 06 13:52:11.941736 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:11.941192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" event={"ID":"9b3950f5-8bb5-43bd-9449-2b352730d7d2","Type":"ContainerStarted","Data":"39786a2ffdc690aae1b6eacaf7ec0b11bc7dcac9a26189b9333ff070bb992c8d"} Jun 06 13:52:11.959991 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:11.959917 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.175690304 podStartE2EDuration="14.959895775s" totalImagesPullingTime="11.759238745s" totalInitContainerRuntime="24.966726ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:52:11.957510235 +0000 UTC m=+228.286049918" watchObservedRunningTime="2026-06-06 13:52:11.959895775 +0000 UTC m=+228.288435442" Jun 06 13:52:11.981729 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:11.981046 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" podStartSLOduration=2.17803478 podStartE2EDuration="12.981000059s" totalImagesPullingTime="10.802965279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:51:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:52:11.980142599 +0000 UTC m=+228.308682267" watchObservedRunningTime="2026-06-06 13:52:11.981000059 +0000 UTC m=+228.309539730" Jun 06 13:52:12.947817 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:12.947724 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:52:12.956776 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:12.956737 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7fb58df84c-qvfg8" Jun 06 13:52:15.992639 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:15.992598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerStarted","Data":"5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934"} Jun 06 13:52:15.993118 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:15.992678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerStarted","Data":"d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a"} Jun 06 13:52:15.993118 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:15.992718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerStarted","Data":"a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6"} Jun 06 13:52:15.993118 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:15.992746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerStarted","Data":"5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f"} Jun 06 13:52:15.993118 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:15.992769 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerStarted","Data":"093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a"} Jun 06 13:52:15.993118 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:15.992798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerStarted","Data":"22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6"} Jun 06 13:52:16.023533 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:16.023481 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.836751227 podStartE2EDuration="14.023463276s" totalImagesPullingTime="4.162228607s" totalInitContainerRuntime="24.483442ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:52:16.020159945 +0000 UTC m=+232.348699612" watchObservedRunningTime="2026-06-06 13:52:16.023463276 +0000 UTC m=+232.352002943" Jun 06 13:52:17.959151 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:17.959113 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:52:35.980913 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:35.980870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:52:35.983387 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:35.983361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9299878a-be24-4725-a280-d9714a5b4ab4-metrics-certs\") pod \"network-metrics-daemon-sbklr\" (UID: \"9299878a-be24-4725-a280-d9714a5b4ab4\") " pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:52:36.136294 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:36.136264 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q9lr7\"" Jun 06 13:52:36.144147 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:36.144123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sbklr" Jun 06 13:52:36.274907 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:36.274824 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sbklr"] Jun 06 13:52:36.278283 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:52:36.278251 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9299878a_be24_4725_a280_d9714a5b4ab4.slice/crio-22625a53d8334e3e5f61f90e8b8b67021273a1644b65b43d559481f4d3d41b0a WatchSource:0}: Error finding container 22625a53d8334e3e5f61f90e8b8b67021273a1644b65b43d559481f4d3d41b0a: Status 404 returned error can't find the container with id 22625a53d8334e3e5f61f90e8b8b67021273a1644b65b43d559481f4d3d41b0a Jun 06 13:52:37.083049 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:37.082997 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbklr" event={"ID":"9299878a-be24-4725-a280-d9714a5b4ab4","Type":"ContainerStarted","Data":"22625a53d8334e3e5f61f90e8b8b67021273a1644b65b43d559481f4d3d41b0a"} Jun 06 13:52:38.088753 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:38.088707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbklr" event={"ID":"9299878a-be24-4725-a280-d9714a5b4ab4","Type":"ContainerStarted","Data":"c6b5d718f1ee0d17386de6f54fa581fa7e3d7ebb1cfaa19af5dbd4ad4d3f47d3"} Jun 06 13:52:38.089201 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:38.088770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sbklr" event={"ID":"9299878a-be24-4725-a280-d9714a5b4ab4","Type":"ContainerStarted","Data":"cd160091452240837b3bd077428b263cba88c85d252e1a7b877825fe95b1bded"} Jun 06 13:52:38.104666 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:38.104616 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sbklr" podStartSLOduration=253.259181563 podStartE2EDuration="4m14.104600249s" totalImagesPullingTime="845.418686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:52:38.103684115 +0000 UTC m=+254.432223781" watchObservedRunningTime="2026-06-06 13:52:38.104600249 +0000 UTC m=+254.433139985" Jun 06 13:52:54.152635 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:54.152599 2578 generic.go:356] "Generic (PLEG): container finished" podID="9d9cbaff-2630-46d9-b6da-971c9ed8430a" containerID="591e4421a99872dc54981787c7cd60caa94d434ca3988b74f6a2f31ebc0b4d90" exitCode=0 Jun 06 13:52:54.153303 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:54.152672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gv8ss" event={"ID":"9d9cbaff-2630-46d9-b6da-971c9ed8430a","Type":"ContainerDied","Data":"591e4421a99872dc54981787c7cd60caa94d434ca3988b74f6a2f31ebc0b4d90"} Jun 06 13:52:54.153303 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:54.153061 2578 scope.go:117] "RemoveContainer" containerID="591e4421a99872dc54981787c7cd60caa94d434ca3988b74f6a2f31ebc0b4d90" Jun 06 13:52:54.154356 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:54.154325 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a99adcd-7a55-4f84-81f6-6e5be45b7879" containerID="cf6571da973e42fa26679126d17621b24e6ff4d2cbadc883a75d9f37c7265728" exitCode=0 Jun 06 13:52:54.154439 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:54.154396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" event={"ID":"9a99adcd-7a55-4f84-81f6-6e5be45b7879","Type":"ContainerDied","Data":"cf6571da973e42fa26679126d17621b24e6ff4d2cbadc883a75d9f37c7265728"} Jun 06 13:52:54.154649 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:54.154637 2578 scope.go:117] "RemoveContainer" containerID="cf6571da973e42fa26679126d17621b24e6ff4d2cbadc883a75d9f37c7265728" Jun 06 13:52:55.160781 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:55.160749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-gv8ss" event={"ID":"9d9cbaff-2630-46d9-b6da-971c9ed8430a","Type":"ContainerStarted","Data":"4bef141c6553cbbaf89e594cb3cbcb7f7a4d843bc82fa6e4a796293b7f7191e8"} Jun 06 13:52:55.162459 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:55.162434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-mmqh5" event={"ID":"9a99adcd-7a55-4f84-81f6-6e5be45b7879","Type":"ContainerStarted","Data":"e5b89abd82e716d1c235755b8dd99394763ecdc7036b4322699e7a88ec429406"} Jun 06 13:52:56.659626 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:56.659595 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ff83de-5896-408f-b592-9e5434596a83/init-config-reloader/0.log" Jun 06 13:52:56.860083 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:56.860048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ff83de-5896-408f-b592-9e5434596a83/alertmanager/0.log" Jun 06 13:52:57.059821 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:57.059739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ff83de-5896-408f-b592-9e5434596a83/config-reloader/0.log" Jun 06 13:52:57.260855 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:57.260819 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ff83de-5896-408f-b592-9e5434596a83/kube-rbac-proxy-web/0.log" Jun 06 13:52:57.461801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:57.461771 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ff83de-5896-408f-b592-9e5434596a83/kube-rbac-proxy/0.log" Jun 06 13:52:57.659072 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:57.659044 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ff83de-5896-408f-b592-9e5434596a83/kube-rbac-proxy-metric/0.log" Jun 06 13:52:57.859730 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:57.859701 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ff83de-5896-408f-b592-9e5434596a83/prom-label-proxy/0.log" Jun 06 13:52:58.259464 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:58.259380 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mchz4_ee00d4cb-4514-454a-b1eb-e21b6a181d04/kube-state-metrics/0.log" Jun 06 13:52:58.459700 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:58.459671 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mchz4_ee00d4cb-4514-454a-b1eb-e21b6a181d04/kube-rbac-proxy-main/0.log" Jun 06 13:52:58.658702 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:58.658663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mchz4_ee00d4cb-4514-454a-b1eb-e21b6a181d04/kube-rbac-proxy-self/0.log" Jun 06 13:52:59.259870 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:59.259842 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zccv_898fe78c-3563-4723-8123-b3c56d421bbd/init-textfile/0.log" Jun 06 13:52:59.460714 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:59.460686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zccv_898fe78c-3563-4723-8123-b3c56d421bbd/node-exporter/0.log" Jun 06 13:52:59.659372 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:52:59.659345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zccv_898fe78c-3563-4723-8123-b3c56d421bbd/kube-rbac-proxy/0.log" Jun 06 13:53:01.660425 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:01.660395 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/init-config-reloader/0.log" Jun 06 13:53:01.861267 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:01.861235 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/prometheus/0.log" Jun 06 13:53:02.059442 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:02.059416 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/config-reloader/0.log" Jun 06 13:53:02.259827 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:02.259753 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/thanos-sidecar/0.log" Jun 06 13:53:02.459301 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:02.459263 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/kube-rbac-proxy-web/0.log" Jun 06 13:53:02.659369 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:02.659332 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/kube-rbac-proxy/0.log" Jun 06 13:53:02.859401 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:02.859373 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/kube-rbac-proxy-thanos/0.log" Jun 06 13:53:02.958465 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:02.958381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:02.974115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:02.974092 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:03.062078 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:03.062046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9jzfq_e6988888-0f46-4e15-8aa1-2ed15ce6d569/prometheus-operator/0.log" Jun 06 13:53:03.209427 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:03.209341 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:03.259374 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:03.259345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9jzfq_e6988888-0f46-4e15-8aa1-2ed15ce6d569/kube-rbac-proxy/0.log" Jun 06 13:53:03.459507 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:03.459424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-ddwkn_51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8/prometheus-operator-admission-webhook/0.log" Jun 06 13:53:03.659688 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:03.659664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87f54c966-x8wqr_0aa09519-8f8f-47d3-91dd-fc4846275774/telemeter-client/0.log" Jun 06 13:53:03.859468 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:03.859439 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87f54c966-x8wqr_0aa09519-8f8f-47d3-91dd-fc4846275774/reload/0.log" Jun 06 13:53:04.059590 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:04.059552 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87f54c966-x8wqr_0aa09519-8f8f-47d3-91dd-fc4846275774/kube-rbac-proxy/0.log" Jun 06 13:53:04.259989 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:04.259916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/thanos-query/0.log" Jun 06 13:53:04.459557 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:04.459526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy-web/0.log" Jun 06 13:53:04.610148 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:04.610114 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9jfsf" podUID="23c2a91d-1644-406e-b1b1-8bd9545d4f7b" Jun 06 13:53:04.659460 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:04.659428 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy/0.log" Jun 06 13:53:04.859410 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:04.859386 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/prom-label-proxy/0.log" Jun 06 13:53:05.059759 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:05.059673 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy-rules/0.log" Jun 06 13:53:05.201217 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:05.201188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9jfsf" Jun 06 13:53:05.259605 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:05.259579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy-metrics/0.log" Jun 06 13:53:06.461676 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:06.461642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-r4w6z_65a6f0ec-b650-426b-9d29-3b6fbb864e62/download-server/0.log" Jun 06 13:53:08.060074 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:08.060046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vvtkr_b214ff39-d422-4f07-9180-798938c62cbd/dns-node-resolver/0.log" Jun 06 13:53:08.383291 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:08.383261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:53:08.385524 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:08.385495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23c2a91d-1644-406e-b1b1-8bd9545d4f7b-metrics-tls\") pod \"dns-default-9jfsf\" (UID: \"23c2a91d-1644-406e-b1b1-8bd9545d4f7b\") " pod="openshift-dns/dns-default-9jfsf" Jun 06 13:53:08.504789 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:08.504760 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2x485\"" Jun 06 13:53:08.512744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:08.512726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9jfsf" Jun 06 13:53:08.656327 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:08.656300 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9jfsf"] Jun 06 13:53:08.658677 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:53:08.658649 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c2a91d_1644_406e_b1b1_8bd9545d4f7b.slice/crio-38e86dcbda16404518adfc9482b2ee68abd63a7c4370d0fcbfb24ec4fa640292 WatchSource:0}: Error finding container 38e86dcbda16404518adfc9482b2ee68abd63a7c4370d0fcbfb24ec4fa640292: Status 404 returned error can't find the container with id 38e86dcbda16404518adfc9482b2ee68abd63a7c4370d0fcbfb24ec4fa640292 Jun 06 13:53:09.219054 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:09.219009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9jfsf" event={"ID":"23c2a91d-1644-406e-b1b1-8bd9545d4f7b","Type":"ContainerStarted","Data":"38e86dcbda16404518adfc9482b2ee68abd63a7c4370d0fcbfb24ec4fa640292"} Jun 06 13:53:09.259717 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:09.259689 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rswsp_8e54b170-c19f-43b1-b4ee-dc50595328ee/node-ca/0.log" Jun 06 13:53:09.460905 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:09.460876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d9fc48c-xpkpp_71bc42da-b610-4f10-97ab-d21003702a8d/router/0.log" Jun 06 13:53:09.860166 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:09.860137 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hd6gw_9bfa30a8-3e12-4903-a2c5-953bea0cecdc/serve-healthcheck-canary/0.log" Jun 06 13:53:11.231459 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:11.231421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9jfsf" event={"ID":"23c2a91d-1644-406e-b1b1-8bd9545d4f7b","Type":"ContainerStarted","Data":"923a88eeb4a860326140c7eb0d7b43d854258dee50bf22f5e13afa8a1de27bec"} Jun 06 13:53:11.231873 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:11.231489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9jfsf" event={"ID":"23c2a91d-1644-406e-b1b1-8bd9545d4f7b","Type":"ContainerStarted","Data":"d24bb76346ccf80b7e01058c33d2fbb116dbf9663b37e2e9a39bb5111e30594b"} Jun 06 13:53:11.231873 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:11.231556 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9jfsf" Jun 06 13:53:11.247826 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:11.247773 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9jfsf" podStartSLOduration=251.747288633 podStartE2EDuration="4m13.247750574s" totalImagesPullingTime="1.500461941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:53:11.246236404 +0000 UTC m=+287.574776104" watchObservedRunningTime="2026-06-06 13:53:11.247750574 +0000 UTC m=+287.576290243" Jun 06 13:53:16.678937 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:16.678898 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:53:16.679448 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:16.679200 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="alertmanager" containerID="cri-o://06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8" gracePeriod=120 Jun 06 13:53:16.679448 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:16.679247 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-metric" containerID="cri-o://132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174" gracePeriod=120 Jun 06 13:53:16.679448 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:16.679301 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="prom-label-proxy" containerID="cri-o://64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30" gracePeriod=120 Jun 06 13:53:16.679448 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:16.679344 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-web" containerID="cri-o://aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b" gracePeriod=120 Jun 06 13:53:16.679448 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:16.679335 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="config-reloader" containerID="cri-o://63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9" gracePeriod=120 Jun 06 13:53:16.679448 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:16.679384 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy" containerID="cri-o://e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b" gracePeriod=120 Jun 06 13:53:17.264807 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264770 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ff83de-5896-408f-b592-9e5434596a83" containerID="64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30" exitCode=0 Jun 06 13:53:17.264807 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264804 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ff83de-5896-408f-b592-9e5434596a83" containerID="e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b" exitCode=0 Jun 06 13:53:17.264807 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264814 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ff83de-5896-408f-b592-9e5434596a83" containerID="63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9" exitCode=0 Jun 06 13:53:17.265062 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264822 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ff83de-5896-408f-b592-9e5434596a83" containerID="06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8" exitCode=0 Jun 06 13:53:17.265062 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30"} Jun 06 13:53:17.265062 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b"} Jun 06 13:53:17.265062 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9"} Jun 06 13:53:17.265062 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.264965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8"} Jun 06 13:53:17.916681 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:17.916655 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.083370 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083273 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-metrics-client-ca\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083370 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083319 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-metric\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083370 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083349 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-config-out\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083373 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-cluster-tls-config\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083415 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083438 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-config-volume\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083468 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083510 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083531 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-tls-assets\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083562 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-web\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083605 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-main-db\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.083643 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083630 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-web-config\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.084099 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083671 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxxgb\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-kube-api-access-fxxgb\") pod \"54ff83de-5896-408f-b592-9e5434596a83\" (UID: \"54ff83de-5896-408f-b592-9e5434596a83\") " Jun 06 13:53:18.084099 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.083846 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:18.084099 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.084008 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.084099 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.084081 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:18.084372 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.084346 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:53:18.086488 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.086439 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-config-volume" (OuterVolumeSpecName: "config-volume") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:18.086999 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.086876 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-config-out" (OuterVolumeSpecName: "config-out") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:53:18.086999 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.086972 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:18.087197 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.087138 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-kube-api-access-fxxgb" (OuterVolumeSpecName: "kube-api-access-fxxgb") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "kube-api-access-fxxgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:53:18.087267 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.087244 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:18.087625 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.087584 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:18.088002 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.087975 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:53:18.088160 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.088145 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:18.090939 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.090911 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:18.097846 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.097818 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-web-config" (OuterVolumeSpecName: "web-config") pod "54ff83de-5896-408f-b592-9e5434596a83" (UID: "54ff83de-5896-408f-b592-9e5434596a83"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:18.185209 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185174 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-config-volume\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185225 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-main-tls\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185240 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185252 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-tls-assets\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185265 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185277 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-alertmanager-main-db\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185289 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-web-config\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185300 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxxgb\" (UniqueName: \"kubernetes.io/projected/54ff83de-5896-408f-b592-9e5434596a83-kube-api-access-fxxgb\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185312 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ff83de-5896-408f-b592-9e5434596a83-metrics-client-ca\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185325 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185338 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ff83de-5896-408f-b592-9e5434596a83-config-out\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.185373 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.185350 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ff83de-5896-408f-b592-9e5434596a83-cluster-tls-config\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:18.272686 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.272653 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ff83de-5896-408f-b592-9e5434596a83" containerID="132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174" exitCode=0 Jun 06 13:53:18.272686 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.272679 2578 generic.go:356] "Generic (PLEG): container finished" podID="54ff83de-5896-408f-b592-9e5434596a83" containerID="aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b" exitCode=0 Jun 06 13:53:18.272869 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.272744 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.272869 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.272738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174"} Jun 06 13:53:18.272936 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.272873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b"} Jun 06 13:53:18.272936 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.272901 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ff83de-5896-408f-b592-9e5434596a83","Type":"ContainerDied","Data":"503ce2bf62aa224b01c9a7a5f6dc6f40edf8fdb00bb4802739bd4bdb19684478"} Jun 06 13:53:18.272936 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.272933 2578 scope.go:117] "RemoveContainer" containerID="64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30" Jun 06 13:53:18.280993 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.280977 2578 scope.go:117] "RemoveContainer" containerID="132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174" Jun 06 13:53:18.288184 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.288167 2578 scope.go:117] "RemoveContainer" containerID="e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b" Jun 06 13:53:18.291200 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.291177 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:53:18.295470 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.295448 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:53:18.296600 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.296585 2578 scope.go:117] "RemoveContainer" containerID="aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b" Jun 06 13:53:18.303484 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.303467 2578 scope.go:117] "RemoveContainer" containerID="63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9" Jun 06 13:53:18.310706 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.310688 2578 scope.go:117] "RemoveContainer" containerID="06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8" Jun 06 13:53:18.318127 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.318109 2578 scope.go:117] "RemoveContainer" containerID="9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15" Jun 06 13:53:18.320378 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320356 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:53:18.320722 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320706 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="init-config-reloader" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320725 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="init-config-reloader" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320739 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-web" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320747 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-web" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320758 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="config-reloader" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320767 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="config-reloader" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320776 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320784 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy" Jun 06 13:53:18.320801 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320799 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="prom-label-proxy" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320808 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="prom-label-proxy" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320826 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-metric" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320835 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-metric" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320850 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="alertmanager" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320858 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="alertmanager" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320957 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-web" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320973 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="config-reloader" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320986 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.320995 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="prom-label-proxy" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.321005 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="kube-rbac-proxy-metric" Jun 06 13:53:18.321180 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.321014 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ff83de-5896-408f-b592-9e5434596a83" containerName="alertmanager" Jun 06 13:53:18.325634 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.325616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.326449 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.326430 2578 scope.go:117] "RemoveContainer" containerID="64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30" Jun 06 13:53:18.326721 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:18.326699 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30\": container with ID starting with 64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30 not found: ID does not exist" containerID="64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30" Jun 06 13:53:18.326796 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.326730 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30"} err="failed to get container status \"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30\": rpc error: code = NotFound desc = could not find container \"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30\": container with ID starting with 64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30 not found: ID does not exist" Jun 06 13:53:18.326796 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.326771 2578 scope.go:117] "RemoveContainer" containerID="132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174" Jun 06 13:53:18.327119 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:18.327096 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174\": container with ID starting with 132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174 not found: ID does not exist" containerID="132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174" Jun 06 13:53:18.327165 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327149 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174"} err="failed to get container status \"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174\": rpc error: code = NotFound desc = could not find container \"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174\": container with ID starting with 132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174 not found: ID does not exist" Jun 06 13:53:18.327208 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327167 2578 scope.go:117] "RemoveContainer" containerID="e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b" Jun 06 13:53:18.327456 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:18.327427 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b\": container with ID starting with e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b not found: ID does not exist" containerID="e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b" Jun 06 13:53:18.327551 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327454 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b"} err="failed to get container status \"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b\": rpc error: code = NotFound desc = could not find container \"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b\": container with ID starting with e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b not found: ID does not exist" Jun 06 13:53:18.327551 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327475 2578 scope.go:117] "RemoveContainer" containerID="aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b" Jun 06 13:53:18.327781 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:18.327754 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b\": container with ID starting with aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b not found: ID does not exist" containerID="aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b" Jun 06 13:53:18.327861 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327787 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b"} err="failed to get container status \"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b\": rpc error: code = NotFound desc = could not find container \"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b\": container with ID starting with aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b not found: ID does not exist" Jun 06 13:53:18.327861 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327808 2578 scope.go:117] "RemoveContainer" containerID="63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9" Jun 06 13:53:18.327972 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327858 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 06 13:53:18.327972 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.327866 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 06 13:53:18.328112 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:18.328091 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9\": container with ID starting with 63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9 not found: ID does not exist" containerID="63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9" Jun 06 13:53:18.328172 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328122 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9"} err="failed to get container status \"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9\": rpc error: code = NotFound desc = could not find container \"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9\": container with ID starting with 63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9 not found: ID does not exist" Jun 06 13:53:18.328172 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328142 2578 scope.go:117] "RemoveContainer" containerID="06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8" Jun 06 13:53:18.328279 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 06 13:53:18.328279 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 06 13:53:18.328381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328312 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 06 13:53:18.328381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328328 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 06 13:53:18.328381 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 06 13:53:18.328526 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328385 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 06 13:53:18.328526 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328440 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hlz5d\"" Jun 06 13:53:18.328709 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:18.328688 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8\": container with ID starting with 06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8 not found: ID does not exist" containerID="06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8" Jun 06 13:53:18.328787 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328715 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8"} err="failed to get container status \"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8\": rpc error: code = NotFound desc = could not find container \"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8\": container with ID starting with 06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8 not found: ID does not exist" Jun 06 13:53:18.328787 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328735 2578 scope.go:117] "RemoveContainer" containerID="9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15" Jun 06 13:53:18.328965 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:18.328945 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15\": container with ID starting with 9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15 not found: ID does not exist" containerID="9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15" Jun 06 13:53:18.329007 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328969 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15"} err="failed to get container status \"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15\": rpc error: code = NotFound desc = could not find container \"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15\": container with ID starting with 9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15 not found: ID does not exist" Jun 06 13:53:18.329007 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.328982 2578 scope.go:117] "RemoveContainer" containerID="64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30" Jun 06 13:53:18.329272 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.329252 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30"} err="failed to get container status \"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30\": rpc error: code = NotFound desc = could not find container \"64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30\": container with ID starting with 64e1a842069fd75b6523a11f2bb832a57a7a5f9d1f50b26da676195d2a3b4b30 not found: ID does not exist" Jun 06 13:53:18.329321 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.329272 2578 scope.go:117] "RemoveContainer" containerID="132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174" Jun 06 13:53:18.329534 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.329509 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174"} err="failed to get container status \"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174\": rpc error: code = NotFound desc = could not find container \"132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174\": container with ID starting with 132bfab9258fb47ead3c26e54dbadaebe3d9f8ab1241b92c2ef77349df547174 not found: ID does not exist" Jun 06 13:53:18.329595 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.329536 2578 scope.go:117] "RemoveContainer" containerID="e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b" Jun 06 13:53:18.329793 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.329775 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b"} err="failed to get container status \"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b\": rpc error: code = NotFound desc = could not find container \"e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b\": container with ID starting with e530f923b648de83aec96d7034ee2582dbb15e0f3b87627cf160953a72cd606b not found: ID does not exist" Jun 06 13:53:18.329838 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.329796 2578 scope.go:117] "RemoveContainer" containerID="aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b" Jun 06 13:53:18.330066 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.330046 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b"} err="failed to get container status \"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b\": rpc error: code = NotFound desc = could not find container \"aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b\": container with ID starting with aaeb7a7f00945437a719a5780697c547468485df0700d6a3f671d10a7246d35b not found: ID does not exist" Jun 06 13:53:18.330131 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.330066 2578 scope.go:117] "RemoveContainer" containerID="63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9" Jun 06 13:53:18.330310 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.330281 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9"} err="failed to get container status \"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9\": rpc error: code = NotFound desc = could not find container \"63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9\": container with ID starting with 63b7aeffd72680dd369a7d7c78b32cae95aea03865948fe0df64e930003523b9 not found: ID does not exist" Jun 06 13:53:18.330359 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.330313 2578 scope.go:117] "RemoveContainer" containerID="06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8" Jun 06 13:53:18.330557 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.330533 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8"} err="failed to get container status \"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8\": rpc error: code = NotFound desc = could not find container \"06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8\": container with ID starting with 06d4031eb5b7c9dc6a48f3980dc2f137efd9c11d841a2935271f410cac4006a8 not found: ID does not exist" Jun 06 13:53:18.330608 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.330561 2578 scope.go:117] "RemoveContainer" containerID="9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15" Jun 06 13:53:18.330826 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.330809 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15"} err="failed to get container status \"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15\": rpc error: code = NotFound desc = could not find container \"9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15\": container with ID starting with 9a8622e2badc19d61dadab8bdfc0331d78c2345cdc35393e0c088eae073f2b15 not found: ID does not exist" Jun 06 13:53:18.333294 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.333275 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 06 13:53:18.336705 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.336684 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:53:18.487923 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.487884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6a78371-7347-4cef-b174-b23de2bac325-config-out\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.487923 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.487925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s9vj\" (UniqueName: \"kubernetes.io/projected/e6a78371-7347-4cef-b174-b23de2bac325-kube-api-access-7s9vj\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488192 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.487964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-config-volume\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488192 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.487990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488192 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6a78371-7347-4cef-b174-b23de2bac325-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488192 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488192 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6a78371-7347-4cef-b174-b23de2bac325-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488192 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488192 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-web-config\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488399 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488399 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6a78371-7347-4cef-b174-b23de2bac325-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488399 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6a78371-7347-4cef-b174-b23de2bac325-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.488399 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.488306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589486 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6a78371-7347-4cef-b174-b23de2bac325-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589486 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589486 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6a78371-7347-4cef-b174-b23de2bac325-config-out\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589486 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s9vj\" (UniqueName: \"kubernetes.io/projected/e6a78371-7347-4cef-b174-b23de2bac325-kube-api-access-7s9vj\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-config-volume\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6a78371-7347-4cef-b174-b23de2bac325-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6a78371-7347-4cef-b174-b23de2bac325-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-web-config\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.589895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.589726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6a78371-7347-4cef-b174-b23de2bac325-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.590700 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.590492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e6a78371-7347-4cef-b174-b23de2bac325-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.590700 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.590689 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6a78371-7347-4cef-b174-b23de2bac325-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.591521 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.591460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6a78371-7347-4cef-b174-b23de2bac325-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.592717 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.592694 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-web-config\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.592813 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.592773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.592921 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.592889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-config-volume\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.593098 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.593075 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6a78371-7347-4cef-b174-b23de2bac325-config-out\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.593177 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.593105 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6a78371-7347-4cef-b174-b23de2bac325-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.593177 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.593167 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.593286 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.593164 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.593931 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.593909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.594228 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.594211 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6a78371-7347-4cef-b174-b23de2bac325-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.596895 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.596879 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s9vj\" (UniqueName: \"kubernetes.io/projected/e6a78371-7347-4cef-b174-b23de2bac325-kube-api-access-7s9vj\") pod \"alertmanager-main-0\" (UID: \"e6a78371-7347-4cef-b174-b23de2bac325\") " pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.637761 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.637739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 06 13:53:18.774871 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:18.774843 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 06 13:53:18.776397 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:53:18.776375 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a78371_7347_4cef_b174_b23de2bac325.slice/crio-803a42f70e1a8bac803473df8c25e78e09be003ccfcf1ffec901f5423cbc8d05 WatchSource:0}: Error finding container 803a42f70e1a8bac803473df8c25e78e09be003ccfcf1ffec901f5423cbc8d05: Status 404 returned error can't find the container with id 803a42f70e1a8bac803473df8c25e78e09be003ccfcf1ffec901f5423cbc8d05 Jun 06 13:53:19.279232 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:19.279196 2578 generic.go:356] "Generic (PLEG): container finished" podID="e6a78371-7347-4cef-b174-b23de2bac325" containerID="e6945df7090b1ce4a059ef526b10247e1616edb1e8f26ba8a19c2eac24c42e5a" exitCode=0 Jun 06 13:53:19.279596 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:19.279239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerDied","Data":"e6945df7090b1ce4a059ef526b10247e1616edb1e8f26ba8a19c2eac24c42e5a"} Jun 06 13:53:19.279596 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:19.279306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerStarted","Data":"803a42f70e1a8bac803473df8c25e78e09be003ccfcf1ffec901f5423cbc8d05"} Jun 06 13:53:20.136995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.136958 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ff83de-5896-408f-b592-9e5434596a83" path="/var/lib/kubelet/pods/54ff83de-5896-408f-b592-9e5434596a83/volumes" Jun 06 13:53:20.287564 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.287537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerStarted","Data":"04770030a4a090beb3beb625e6372486d63cfdf0d08203c83e2335449d343691"} Jun 06 13:53:20.287915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.287597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerStarted","Data":"91536bd7644a20d908a983c9445ccb9961a5589bf420d0f3fd3104bbe8985513"} Jun 06 13:53:20.287915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.287623 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerStarted","Data":"ae2dc795cc07a1be3033e82c42cd07bb1821f9d32bedd4d790efc1563afaa308"} Jun 06 13:53:20.287915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.287677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerStarted","Data":"d2521b502fe96a3d35b34df84da5579fa7acd5695d2d1481555297b87f9a5450"} Jun 06 13:53:20.287915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.287701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerStarted","Data":"8509f256067d1e7d405eb163506b881c9dd7cd34d6f1ba54ddc7a57366183fca"} Jun 06 13:53:20.287915 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.287728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e6a78371-7347-4cef-b174-b23de2bac325","Type":"ContainerStarted","Data":"678a530aa5946c60f0a7679457dd4e379ddf0d211500f41e39dfeaa23d9acd58"} Jun 06 13:53:20.315115 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.315048 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.296035143 podStartE2EDuration="2.31501137s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.976227ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:53:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:53:20.31045397 +0000 UTC m=+296.638993666" watchObservedRunningTime="2026-06-06 13:53:20.31501137 +0000 UTC m=+296.643551037" Jun 06 13:53:20.891464 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.891431 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:53:20.891774 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.891731 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="prometheus" containerID="cri-o://22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6" gracePeriod=600 Jun 06 13:53:20.891774 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.891754 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy" containerID="cri-o://d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a" gracePeriod=600 Jun 06 13:53:20.891980 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.891780 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="thanos-sidecar" containerID="cri-o://5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f" gracePeriod=600 Jun 06 13:53:20.891980 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.891817 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="config-reloader" containerID="cri-o://093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a" gracePeriod=600 Jun 06 13:53:20.891980 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.891845 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934" gracePeriod=600 Jun 06 13:53:20.891980 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:20.891791 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-web" containerID="cri-o://a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6" gracePeriod=600 Jun 06 13:53:21.239506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.239419 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9jfsf" Jun 06 13:53:21.297481 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297455 2578 generic.go:356] "Generic (PLEG): container finished" podID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerID="5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934" exitCode=0 Jun 06 13:53:21.297481 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297478 2578 generic.go:356] "Generic (PLEG): container finished" podID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerID="d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a" exitCode=0 Jun 06 13:53:21.297481 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297486 2578 generic.go:356] "Generic (PLEG): container finished" podID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerID="5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f" exitCode=0 Jun 06 13:53:21.297879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297492 2578 generic.go:356] "Generic (PLEG): container finished" podID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerID="093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a" exitCode=0 Jun 06 13:53:21.297879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297503 2578 generic.go:356] "Generic (PLEG): container finished" podID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerID="22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6" exitCode=0 Jun 06 13:53:21.297879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934"} Jun 06 13:53:21.297879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a"} Jun 06 13:53:21.297879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f"} Jun 06 13:53:21.297879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a"} Jun 06 13:53:21.297879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:21.297702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6"} Jun 06 13:53:22.137391 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.137367 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.228933 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.228839 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-1\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.228933 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.228877 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-metrics-client-certs\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.228933 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.228894 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-2\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.228933 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.228916 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-db\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.228933 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.228937 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-tls-assets\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.228970 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-metrics-client-ca\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.228995 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config-out\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229015 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-web-config\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229324 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:22.229506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229388 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:22.229506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229428 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-trusted-ca-bundle\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229462 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229506 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229499 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-thanos-prometheus-http-client-file\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229529 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-grpc-tls\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229565 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-kubelet-serving-ca-bundle\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229594 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-tls\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229620 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229667 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-0\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229701 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz8jm\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-kube-api-access-lz8jm\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.229737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229704 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:22.230097 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229759 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-kube-rbac-proxy\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.230097 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229784 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.230097 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229840 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:22.230097 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.229850 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-serving-certs-ca-bundle\") pod \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\" (UID: \"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6\") " Jun 06 13:53:22.230097 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.230004 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:53:22.230545 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.230121 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:22.230545 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.230279 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:22.231468 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231441 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.231580 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231474 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.231580 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231489 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.231580 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231502 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-db\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.231580 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231515 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-metrics-client-ca\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.231580 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231528 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.231580 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231542 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.231878 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.231803 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:53:22.232762 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.232733 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:53:22.233628 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.233527 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.233903 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.233787 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.234043 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.234000 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.234110 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.234057 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.234438 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.234412 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config-out" (OuterVolumeSpecName: "config-out") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:53:22.234609 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.234574 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.234736 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.234716 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config" (OuterVolumeSpecName: "config") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.234811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.234741 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.234811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.234747 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-kube-api-access-lz8jm" (OuterVolumeSpecName: "kube-api-access-lz8jm") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "kube-api-access-lz8jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:53:22.235693 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.235673 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.244181 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.244157 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-web-config" (OuterVolumeSpecName: "web-config") pod "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" (UID: "2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:53:22.305219 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.305183 2578 generic.go:356] "Generic (PLEG): container finished" podID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerID="a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6" exitCode=0 Jun 06 13:53:22.305581 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.305269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6"} Jun 06 13:53:22.305581 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.305338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6","Type":"ContainerDied","Data":"9e7fa18ff6b1f6f25a201720ea974322926cbab516a1eaccf0a4ada01352116d"} Jun 06 13:53:22.305581 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.305276 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.305581 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.305373 2578 scope.go:117] "RemoveContainer" containerID="5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934" Jun 06 13:53:22.313563 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.313549 2578 scope.go:117] "RemoveContainer" containerID="d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a" Jun 06 13:53:22.320756 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.320739 2578 scope.go:117] "RemoveContainer" containerID="a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6" Jun 06 13:53:22.327940 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.327903 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:53:22.328139 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.327916 2578 scope.go:117] "RemoveContainer" containerID="5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f" Jun 06 13:53:22.332247 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332223 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:53:22.332340 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332228 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-metrics-client-certs\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332340 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332290 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-tls-assets\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332340 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332304 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config-out\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332340 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332316 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-web-config\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332340 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332329 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332344 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332359 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-grpc-tls\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332374 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332388 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332402 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332416 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz8jm\" (UniqueName: \"kubernetes.io/projected/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-kube-api-access-lz8jm\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332429 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-secret-kube-rbac-proxy\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.332544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.332444 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6-config\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:53:22.335570 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.335554 2578 scope.go:117] "RemoveContainer" containerID="093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a" Jun 06 13:53:22.342149 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.342132 2578 scope.go:117] "RemoveContainer" containerID="22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6" Jun 06 13:53:22.349473 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.349457 2578 scope.go:117] "RemoveContainer" containerID="63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.354932 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355393 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-web" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355408 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-web" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355418 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355427 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355443 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="prometheus" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355451 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="prometheus" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355460 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-thanos" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355467 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-thanos" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355477 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="init-config-reloader" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355487 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="init-config-reloader" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355499 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="config-reloader" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355507 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="config-reloader" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355530 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="thanos-sidecar" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355537 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="thanos-sidecar" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355625 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="prometheus" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355638 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="thanos-sidecar" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355647 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-web" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355656 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="config-reloader" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355664 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy-thanos" Jun 06 13:53:22.357480 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.355673 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" containerName="kube-rbac-proxy" Jun 06 13:53:22.358641 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.358599 2578 scope.go:117] "RemoveContainer" containerID="5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934" Jun 06 13:53:22.358940 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:22.358918 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934\": container with ID starting with 5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934 not found: ID does not exist" containerID="5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934" Jun 06 13:53:22.359018 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.358946 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934"} err="failed to get container status \"5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934\": rpc error: code = NotFound desc = could not find container \"5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934\": container with ID starting with 5c8667f61b18c92fdd9042949c38fcaf98b88d161622c5150f223be501558934 not found: ID does not exist" Jun 06 13:53:22.359018 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.358969 2578 scope.go:117] "RemoveContainer" containerID="d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a" Jun 06 13:53:22.359243 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:22.359224 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a\": container with ID starting with d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a not found: ID does not exist" containerID="d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a" Jun 06 13:53:22.359283 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.359247 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a"} err="failed to get container status \"d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a\": rpc error: code = NotFound desc = could not find container \"d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a\": container with ID starting with d2a5fb5d8f7d9250d20950da3c47b1b375c0be56e56bd21160e7573d963d295a not found: ID does not exist" Jun 06 13:53:22.359283 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.359260 2578 scope.go:117] "RemoveContainer" containerID="a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6" Jun 06 13:53:22.359573 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:22.359556 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6\": container with ID starting with a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6 not found: ID does not exist" containerID="a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6" Jun 06 13:53:22.359644 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.359576 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6"} err="failed to get container status \"a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6\": rpc error: code = NotFound desc = could not find container \"a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6\": container with ID starting with a3855d7b43001f9748763c08b658dd4192f0dcb0a82bb8cccdea2e5d60b116c6 not found: ID does not exist" Jun 06 13:53:22.359644 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.359590 2578 scope.go:117] "RemoveContainer" containerID="5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f" Jun 06 13:53:22.359887 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:22.359869 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f\": container with ID starting with 5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f not found: ID does not exist" containerID="5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f" Jun 06 13:53:22.359953 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.359890 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f"} err="failed to get container status \"5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f\": rpc error: code = NotFound desc = could not find container \"5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f\": container with ID starting with 5af7a3d204304c7c1b2739e50d7afeb2f7d9542dffc60a1a4926b186d99c539f not found: ID does not exist" Jun 06 13:53:22.359953 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.359903 2578 scope.go:117] "RemoveContainer" containerID="093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a" Jun 06 13:53:22.360164 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:22.360148 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a\": container with ID starting with 093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a not found: ID does not exist" containerID="093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a" Jun 06 13:53:22.360222 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.360168 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a"} err="failed to get container status \"093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a\": rpc error: code = NotFound desc = could not find container \"093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a\": container with ID starting with 093a9b4df63d1dd04fd717ed099a457c8b438dfd756d1c7af48244798e66b44a not found: ID does not exist" Jun 06 13:53:22.360222 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.360185 2578 scope.go:117] "RemoveContainer" containerID="22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6" Jun 06 13:53:22.360406 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:22.360390 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6\": container with ID starting with 22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6 not found: ID does not exist" containerID="22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6" Jun 06 13:53:22.360469 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.360408 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6"} err="failed to get container status \"22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6\": rpc error: code = NotFound desc = could not find container \"22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6\": container with ID starting with 22db9822436e3e24cfe5e83bae7be74e059eca98bcc48a9ce67838921757e9e6 not found: ID does not exist" Jun 06 13:53:22.360469 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.360428 2578 scope.go:117] "RemoveContainer" containerID="63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf" Jun 06 13:53:22.360565 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.360550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.360628 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:53:22.360613 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf\": container with ID starting with 63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf not found: ID does not exist" containerID="63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf" Jun 06 13:53:22.360677 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.360630 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf"} err="failed to get container status \"63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf\": rpc error: code = NotFound desc = could not find container \"63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf\": container with ID starting with 63b9355fae71fa6b56885fff7cafd09e2549ac1c2f63ee161c39d588aecebfcf not found: ID does not exist" Jun 06 13:53:22.363164 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363140 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 13:53:22.363274 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363151 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 13:53:22.363274 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363201 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 13:53:22.363397 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363344 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 13:53:22.363671 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363652 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 13:53:22.363770 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363686 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 13:53:22.363770 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363701 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a6l9leua7en36\"" Jun 06 13:53:22.363770 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363723 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 13:53:22.363927 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 13:53:22.363927 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363851 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 13:53:22.363995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363937 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 13:53:22.363995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.363952 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 13:53:22.364098 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.364009 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 13:53:22.364158 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.364136 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4t4f\"" Jun 06 13:53:22.364224 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.364199 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 13:53:22.373050 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.372439 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 13:53:22.375863 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.375833 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 13:53:22.377882 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.377863 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:53:22.534220 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534220 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-config\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534220 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7gl\" (UniqueName: \"kubernetes.io/projected/fb94000c-4d10-46db-bf84-00e2416b12bf-kube-api-access-fr7gl\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534478 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb94000c-4d10-46db-bf84-00e2416b12bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb94000c-4d10-46db-bf84-00e2416b12bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.534719 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.534720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.635620 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.635777 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.635777 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.635777 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.635777 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.635777 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb94000c-4d10-46db-bf84-00e2416b12bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb94000c-4d10-46db-bf84-00e2416b12bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-config\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.635992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636132 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7gl\" (UniqueName: \"kubernetes.io/projected/fb94000c-4d10-46db-bf84-00e2416b12bf-kube-api-access-fr7gl\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636606 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636606 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636606 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636606 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636578 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.636878 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.636854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.637281 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.637254 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.638777 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.638748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb94000c-4d10-46db-bf84-00e2416b12bf-config-out\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.638943 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.638919 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.639010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.638971 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.639104 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.639040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.639556 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.639530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb94000c-4d10-46db-bf84-00e2416b12bf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.639684 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.639664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-config\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.639804 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.639779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.640289 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.640259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.640591 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.640570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.640724 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.640580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.641109 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.641083 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fb94000c-4d10-46db-bf84-00e2416b12bf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.641328 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.641307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.641405 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.641366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-web-config\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.641567 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.641551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.641778 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.641765 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb94000c-4d10-46db-bf84-00e2416b12bf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.647980 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.647963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7gl\" (UniqueName: \"kubernetes.io/projected/fb94000c-4d10-46db-bf84-00e2416b12bf-kube-api-access-fr7gl\") pod \"prometheus-k8s-0\" (UID: \"fb94000c-4d10-46db-bf84-00e2416b12bf\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.672976 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.672938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:53:22.815127 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:22.815102 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 13:53:22.816781 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:53:22.816760 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb94000c_4d10_46db_bf84_00e2416b12bf.slice/crio-5355d5f9cfbcaaef8b3058d57839fcbbc0ee8f7c7a3cc30cae68b95f363eb820 WatchSource:0}: Error finding container 5355d5f9cfbcaaef8b3058d57839fcbbc0ee8f7c7a3cc30cae68b95f363eb820: Status 404 returned error can't find the container with id 5355d5f9cfbcaaef8b3058d57839fcbbc0ee8f7c7a3cc30cae68b95f363eb820 Jun 06 13:53:23.311048 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:23.310997 2578 generic.go:356] "Generic (PLEG): container finished" podID="fb94000c-4d10-46db-bf84-00e2416b12bf" containerID="c7632335887b23abe28c24238a3cccb42a12a6dbb15657026aa0fccc0f9d51e7" exitCode=0 Jun 06 13:53:23.311468 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:23.311055 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerDied","Data":"c7632335887b23abe28c24238a3cccb42a12a6dbb15657026aa0fccc0f9d51e7"} Jun 06 13:53:23.311468 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:23.311131 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerStarted","Data":"5355d5f9cfbcaaef8b3058d57839fcbbc0ee8f7c7a3cc30cae68b95f363eb820"} Jun 06 13:53:24.093866 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.093847 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 13:53:24.137167 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.137049 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6" path="/var/lib/kubelet/pods/2dd674fa-0a5e-4f2d-8e53-d82598a3c1a6/volumes" Jun 06 13:53:24.322964 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.322922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerStarted","Data":"9be590960b788ac056214f0ea0514de4cf49f326d4eca9c91c33d196c0624914"} Jun 06 13:53:24.323360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.323002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerStarted","Data":"b1c0e2565ac5ca74f580437dd283b7af8159c2f7c5d22176ed7e3af3ba440930"} Jun 06 13:53:24.323360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.323060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerStarted","Data":"0876c6c556a48cab09808e95681165637f201bdd9e326647861cdf27485c4063"} Jun 06 13:53:24.323360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.323101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerStarted","Data":"e06855672e1d1a1ef44e0afb9e8250523b173aa81fb4af158af496afaab89552"} Jun 06 13:53:24.323360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.323142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerStarted","Data":"a4c969279c46b5482502454ea084c360ddbb12cefa522555bf021cc71604c73c"} Jun 06 13:53:24.323360 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.323179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fb94000c-4d10-46db-bf84-00e2416b12bf","Type":"ContainerStarted","Data":"b33db5ed26f6b1e18e5b0ada8f97dda5d2e19a0c6a5d49b78026dc50697e1bca"} Jun 06 13:53:24.352055 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:24.351927 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.333991951 podStartE2EDuration="2.351909998s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.918047ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:53:24.349680818 +0000 UTC m=+300.678220497" watchObservedRunningTime="2026-06-06 13:53:24.351909998 +0000 UTC m=+300.680449665" Jun 06 13:53:27.673767 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:53:27.673727 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:54:22.673996 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:54:22.673896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:54:22.689315 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:54:22.689280 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:54:23.590503 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:54:23.590472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 13:55:32.783955 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.783923 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw"] Jun 06 13:55:32.786987 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.786969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.789776 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.789725 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 13:55:32.789776 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.789758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 13:55:32.789954 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.789869 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 13:55:32.790007 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.789974 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rhxj2\"" Jun 06 13:55:32.790007 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.790001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 13:55:32.803536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.803515 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw"] Jun 06 13:55:32.887212 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.887177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edae3eb6-ce24-409f-80e9-2578d4f9c654-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.887212 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.887216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edae3eb6-ce24-409f-80e9-2578d4f9c654-manifests\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.887417 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.887232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edae3eb6-ce24-409f-80e9-2578d4f9c654-tmp\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.887417 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.887288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edae3eb6-ce24-409f-80e9-2578d4f9c654-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.887417 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.887305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fbtv\" (UniqueName: \"kubernetes.io/projected/edae3eb6-ce24-409f-80e9-2578d4f9c654-kube-api-access-2fbtv\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.988451 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.988413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edae3eb6-ce24-409f-80e9-2578d4f9c654-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.988656 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.988467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edae3eb6-ce24-409f-80e9-2578d4f9c654-manifests\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.988656 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.988492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edae3eb6-ce24-409f-80e9-2578d4f9c654-tmp\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.988656 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.988534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edae3eb6-ce24-409f-80e9-2578d4f9c654-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.988656 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.988557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fbtv\" (UniqueName: \"kubernetes.io/projected/edae3eb6-ce24-409f-80e9-2578d4f9c654-kube-api-access-2fbtv\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.988987 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.988959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edae3eb6-ce24-409f-80e9-2578d4f9c654-manifests\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.990991 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.990968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edae3eb6-ce24-409f-80e9-2578d4f9c654-tmp\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.991103 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.991006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edae3eb6-ce24-409f-80e9-2578d4f9c654-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.991144 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.991120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edae3eb6-ce24-409f-80e9-2578d4f9c654-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:32.998866 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:32.998841 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fbtv\" (UniqueName: \"kubernetes.io/projected/edae3eb6-ce24-409f-80e9-2578d4f9c654-kube-api-access-2fbtv\") pod \"opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw\" (UID: \"edae3eb6-ce24-409f-80e9-2578d4f9c654\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:33.098198 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:33.098109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:33.234442 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:33.234418 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw"] Jun 06 13:55:33.237499 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:55:33.237465 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedae3eb6_ce24_409f_80e9_2578d4f9c654.slice/crio-a7d6d3a84ec644a0594a77e1dc433c4779922dc824e3180faf9121220975a735 WatchSource:0}: Error finding container a7d6d3a84ec644a0594a77e1dc433c4779922dc824e3180faf9121220975a735: Status 404 returned error can't find the container with id a7d6d3a84ec644a0594a77e1dc433c4779922dc824e3180faf9121220975a735 Jun 06 13:55:33.239410 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:33.239391 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:55:33.865906 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:33.865845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" event={"ID":"edae3eb6-ce24-409f-80e9-2578d4f9c654","Type":"ContainerStarted","Data":"a7d6d3a84ec644a0594a77e1dc433c4779922dc824e3180faf9121220975a735"} Jun 06 13:55:36.881688 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:36.881650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" event={"ID":"edae3eb6-ce24-409f-80e9-2578d4f9c654","Type":"ContainerStarted","Data":"e6e3363e32fdc7c80c2c0e4a09a0becc7d750e2794751cf55e322d54dddd936b"} Jun 06 13:55:37.887603 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:37.887567 2578 generic.go:356] "Generic (PLEG): container finished" podID="edae3eb6-ce24-409f-80e9-2578d4f9c654" containerID="e6e3363e32fdc7c80c2c0e4a09a0becc7d750e2794751cf55e322d54dddd936b" exitCode=0 Jun 06 13:55:37.887998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:37.887618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" event={"ID":"edae3eb6-ce24-409f-80e9-2578d4f9c654","Type":"ContainerDied","Data":"e6e3363e32fdc7c80c2c0e4a09a0becc7d750e2794751cf55e322d54dddd936b"} Jun 06 13:55:38.893871 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:38.893839 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" event={"ID":"edae3eb6-ce24-409f-80e9-2578d4f9c654","Type":"ContainerStarted","Data":"2d3b312766796727bd3d737e4a91621df7b9a5331042c7163dc0abfdaf3bdca6"} Jun 06 13:55:38.894269 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:38.893939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:55:38.914041 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:38.913973 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" podStartSLOduration=2.7222012639999997 podStartE2EDuration="6.913957713s" totalImagesPullingTime="3.232942264s" totalInitContainerRuntime="958.814185ms" isStatefulPod=false podCreationTimestamp="2026-06-06 13:55:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:55:38.912428923 +0000 UTC m=+435.240968589" watchObservedRunningTime="2026-06-06 13:55:38.913957713 +0000 UTC m=+435.242497379" Jun 06 13:55:49.901211 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:55:49.901130 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw" Jun 06 13:56:00.336181 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.336147 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh"] Jun 06 13:56:00.344547 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.344522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.348555 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.348292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 06 13:56:00.348555 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.348367 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 13:56:00.348555 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.348379 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:56:00.348555 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.348468 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 06 13:56:00.348555 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.348520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 06 13:56:00.348881 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.348679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n6pn2\"" Jun 06 13:56:00.349169 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.349147 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh"] Jun 06 13:56:00.442572 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.442524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae8bcc46-d059-42e2-8678-3d2996820124-manager-config\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.442751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.442606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae8bcc46-d059-42e2-8678-3d2996820124-metrics-cert\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.442751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.442641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdlxd\" (UniqueName: \"kubernetes.io/projected/ae8bcc46-d059-42e2-8678-3d2996820124-kube-api-access-wdlxd\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.442751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.442702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae8bcc46-d059-42e2-8678-3d2996820124-cert\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.543975 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.543941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae8bcc46-d059-42e2-8678-3d2996820124-metrics-cert\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.544165 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.543996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdlxd\" (UniqueName: \"kubernetes.io/projected/ae8bcc46-d059-42e2-8678-3d2996820124-kube-api-access-wdlxd\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.544165 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.544059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae8bcc46-d059-42e2-8678-3d2996820124-cert\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.544165 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.544100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae8bcc46-d059-42e2-8678-3d2996820124-manager-config\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.544757 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.544734 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae8bcc46-d059-42e2-8678-3d2996820124-manager-config\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.546651 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.546626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae8bcc46-d059-42e2-8678-3d2996820124-cert\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.546651 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.546638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae8bcc46-d059-42e2-8678-3d2996820124-metrics-cert\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.552686 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.552662 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdlxd\" (UniqueName: \"kubernetes.io/projected/ae8bcc46-d059-42e2-8678-3d2996820124-kube-api-access-wdlxd\") pod \"lws-controller-manager-67798f9b5c-qczlh\" (UID: \"ae8bcc46-d059-42e2-8678-3d2996820124\") " pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.655265 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.655227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:00.779806 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.779769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh"] Jun 06 13:56:00.782658 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:56:00.782631 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8bcc46_d059_42e2_8678_3d2996820124.slice/crio-faff613662b4ef71039675bdbaa42d3861b20c66bacf6998ae33cc061cd37045 WatchSource:0}: Error finding container faff613662b4ef71039675bdbaa42d3861b20c66bacf6998ae33cc061cd37045: Status 404 returned error can't find the container with id faff613662b4ef71039675bdbaa42d3861b20c66bacf6998ae33cc061cd37045 Jun 06 13:56:00.995796 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:00.995711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" event={"ID":"ae8bcc46-d059-42e2-8678-3d2996820124","Type":"ContainerStarted","Data":"faff613662b4ef71039675bdbaa42d3861b20c66bacf6998ae33cc061cd37045"} Jun 06 13:56:07.028220 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:07.028177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" event={"ID":"ae8bcc46-d059-42e2-8678-3d2996820124","Type":"ContainerStarted","Data":"8d721a92923657dae77c5be237be9bd464b921f07ec99a90993679cc0bf5b4f1"} Jun 06 13:56:07.028623 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:07.028246 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:07.044387 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:07.044336 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" podStartSLOduration=0.997879984 podStartE2EDuration="7.044320285s" totalImagesPullingTime="6.046440301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:56:07.04286098 +0000 UTC m=+463.371400647" watchObservedRunningTime="2026-06-06 13:56:07.044320285 +0000 UTC m=+463.372859951" Jun 06 13:56:18.035276 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:18.035245 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67798f9b5c-qczlh" Jun 06 13:56:22.277923 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.277891 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6478c66b55-bk64g"] Jun 06 13:56:22.281645 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.281623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.284137 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.284115 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 13:56:22.284273 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.284144 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pl5j6\"" Jun 06 13:56:22.291086 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.291059 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6478c66b55-bk64g"] Jun 06 13:56:22.449166 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.449124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bhc2\" (UniqueName: \"kubernetes.io/projected/b32b1db9-75cf-4767-ace5-c1d925250aff-kube-api-access-4bhc2\") pod \"dashboard-redirect-6478c66b55-bk64g\" (UID: \"b32b1db9-75cf-4767-ace5-c1d925250aff\") " pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.449406 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.449258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b32b1db9-75cf-4767-ace5-c1d925250aff-redirect-config\") pod \"dashboard-redirect-6478c66b55-bk64g\" (UID: \"b32b1db9-75cf-4767-ace5-c1d925250aff\") " pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.550515 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.550414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b32b1db9-75cf-4767-ace5-c1d925250aff-redirect-config\") pod \"dashboard-redirect-6478c66b55-bk64g\" (UID: \"b32b1db9-75cf-4767-ace5-c1d925250aff\") " pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.550515 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.550484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bhc2\" (UniqueName: \"kubernetes.io/projected/b32b1db9-75cf-4767-ace5-c1d925250aff-kube-api-access-4bhc2\") pod \"dashboard-redirect-6478c66b55-bk64g\" (UID: \"b32b1db9-75cf-4767-ace5-c1d925250aff\") " pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.551206 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.551183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b32b1db9-75cf-4767-ace5-c1d925250aff-redirect-config\") pod \"dashboard-redirect-6478c66b55-bk64g\" (UID: \"b32b1db9-75cf-4767-ace5-c1d925250aff\") " pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.557696 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.557675 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bhc2\" (UniqueName: \"kubernetes.io/projected/b32b1db9-75cf-4767-ace5-c1d925250aff-kube-api-access-4bhc2\") pod \"dashboard-redirect-6478c66b55-bk64g\" (UID: \"b32b1db9-75cf-4767-ace5-c1d925250aff\") " pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.593650 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.593627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" Jun 06 13:56:22.719143 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:22.719067 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6478c66b55-bk64g"] Jun 06 13:56:22.721761 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:56:22.721733 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32b1db9_75cf_4767_ace5_c1d925250aff.slice/crio-1f7233a4e47c34713651f7843a22728ca3ed32b97ee63e2f8b7648a647b954f9 WatchSource:0}: Error finding container 1f7233a4e47c34713651f7843a22728ca3ed32b97ee63e2f8b7648a647b954f9: Status 404 returned error can't find the container with id 1f7233a4e47c34713651f7843a22728ca3ed32b97ee63e2f8b7648a647b954f9 Jun 06 13:56:23.105770 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:23.105736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" event={"ID":"b32b1db9-75cf-4767-ace5-c1d925250aff","Type":"ContainerStarted","Data":"1f7233a4e47c34713651f7843a22728ca3ed32b97ee63e2f8b7648a647b954f9"} Jun 06 13:56:26.123314 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:26.123274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" event={"ID":"b32b1db9-75cf-4767-ace5-c1d925250aff","Type":"ContainerStarted","Data":"ee925a25c4dfdd7f437889ad577e2ed09490a61440ca27d226e32d007c39367e"} Jun 06 13:56:26.139761 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:26.139686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6478c66b55-bk64g" podStartSLOduration=1.701072036 podStartE2EDuration="4.13966731s" totalImagesPullingTime="2.438595274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:56:26.137571504 +0000 UTC m=+482.466111168" watchObservedRunningTime="2026-06-06 13:56:26.13966731 +0000 UTC m=+482.468206978" Jun 06 13:56:27.395300 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.395266 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw"] Jun 06 13:56:27.399350 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.399322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.401733 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.401709 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 13:56:27.401733 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.401725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fdf94\"" Jun 06 13:56:27.409756 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.409733 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw"] Jun 06 13:56:27.497564 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497728 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497728 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvhtq\" (UniqueName: \"kubernetes.io/projected/848491b0-b204-4342-acd5-b23db745f7f2-kube-api-access-gvhtq\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497728 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497728 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497881 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/848491b0-b204-4342-acd5-b23db745f7f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497881 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497881 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/848491b0-b204-4342-acd5-b23db745f7f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.497881 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.497851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/848491b0-b204-4342-acd5-b23db745f7f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.598651 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.598846 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.598846 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvhtq\" (UniqueName: \"kubernetes.io/projected/848491b0-b204-4342-acd5-b23db745f7f2-kube-api-access-gvhtq\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.598846 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.598846 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/848491b0-b204-4342-acd5-b23db745f7f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.598963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/848491b0-b204-4342-acd5-b23db745f7f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.599001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/848491b0-b204-4342-acd5-b23db745f7f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599286 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.599090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599286 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.599104 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599286 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.599165 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599603 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.599582 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.599774 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.599748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/848491b0-b204-4342-acd5-b23db745f7f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.601415 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.601383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/848491b0-b204-4342-acd5-b23db745f7f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.601550 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.601532 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/848491b0-b204-4342-acd5-b23db745f7f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.606607 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.606586 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/848491b0-b204-4342-acd5-b23db745f7f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.606726 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.606657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvhtq\" (UniqueName: \"kubernetes.io/projected/848491b0-b204-4342-acd5-b23db745f7f2-kube-api-access-gvhtq\") pod \"data-science-gateway-data-science-gateway-class-74759f9795p9ghw\" (UID: \"848491b0-b204-4342-acd5-b23db745f7f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.713670 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.713576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:27.849686 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:27.849641 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw"] Jun 06 13:56:27.852011 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:56:27.851985 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848491b0_b204_4342_acd5_b23db745f7f2.slice/crio-1611af8c6119fe53af18d51d6e95f4e1399f8898d15dbe696c0a1bd14b7b9498 WatchSource:0}: Error finding container 1611af8c6119fe53af18d51d6e95f4e1399f8898d15dbe696c0a1bd14b7b9498: Status 404 returned error can't find the container with id 1611af8c6119fe53af18d51d6e95f4e1399f8898d15dbe696c0a1bd14b7b9498 Jun 06 13:56:28.137978 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:28.137943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" event={"ID":"848491b0-b204-4342-acd5-b23db745f7f2","Type":"ContainerStarted","Data":"1611af8c6119fe53af18d51d6e95f4e1399f8898d15dbe696c0a1bd14b7b9498"} Jun 06 13:56:30.924811 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:30.924771 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 13:56:30.925104 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:30.924851 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 13:56:30.925104 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:30.924878 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 13:56:31.152691 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:31.152653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" event={"ID":"848491b0-b204-4342-acd5-b23db745f7f2","Type":"ContainerStarted","Data":"52409787fefd167899a7d8407a0f44781e43057a98e16af6a00d2f520c8d86c4"} Jun 06 13:56:31.173733 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:31.173622 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" podStartSLOduration=1.103625331 podStartE2EDuration="4.17360101s" totalImagesPullingTime="3.069975679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:56:31.172065795 +0000 UTC m=+487.500605485" watchObservedRunningTime="2026-06-06 13:56:31.17360101 +0000 UTC m=+487.502140677" Jun 06 13:56:31.714102 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:31.714063 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:31.718604 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:31.718580 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:32.156683 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:32.156653 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:32.157790 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:32.157768 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795p9ghw" Jun 06 13:56:53.186899 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.186858 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h9xb8"] Jun 06 13:56:53.190598 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.190578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" Jun 06 13:56:53.192998 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.192975 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 13:56:53.194112 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.194095 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 13:56:53.194112 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.194101 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7nxqc\"" Jun 06 13:56:53.200914 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.200880 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h9xb8"] Jun 06 13:56:53.236485 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.236288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm6xl\" (UniqueName: \"kubernetes.io/projected/693b5e26-98f2-4052-acad-46affc8c55eb-kube-api-access-zm6xl\") pod \"kuadrant-operator-catalog-h9xb8\" (UID: \"693b5e26-98f2-4052-acad-46affc8c55eb\") " pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" Jun 06 13:56:53.336946 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.336909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm6xl\" (UniqueName: \"kubernetes.io/projected/693b5e26-98f2-4052-acad-46affc8c55eb-kube-api-access-zm6xl\") pod \"kuadrant-operator-catalog-h9xb8\" (UID: \"693b5e26-98f2-4052-acad-46affc8c55eb\") " pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" Jun 06 13:56:53.344660 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.344634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm6xl\" (UniqueName: \"kubernetes.io/projected/693b5e26-98f2-4052-acad-46affc8c55eb-kube-api-access-zm6xl\") pod \"kuadrant-operator-catalog-h9xb8\" (UID: \"693b5e26-98f2-4052-acad-46affc8c55eb\") " pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" Jun 06 13:56:53.503544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.503424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" Jun 06 13:56:53.554143 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.552471 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h9xb8"] Jun 06 13:56:53.637319 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.637290 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h9xb8"] Jun 06 13:56:53.640285 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:56:53.640255 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693b5e26_98f2_4052_acad_46affc8c55eb.slice/crio-8e549ae192c24b3084f5a5e971f94d5016e7a12e736f56645cd76e6d9acb35ba WatchSource:0}: Error finding container 8e549ae192c24b3084f5a5e971f94d5016e7a12e736f56645cd76e6d9acb35ba: Status 404 returned error can't find the container with id 8e549ae192c24b3084f5a5e971f94d5016e7a12e736f56645cd76e6d9acb35ba Jun 06 13:56:53.760087 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.759987 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n4cw6"] Jun 06 13:56:53.764565 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.764546 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:56:53.770273 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.770238 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n4cw6"] Jun 06 13:56:53.840911 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.840879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj65k\" (UniqueName: \"kubernetes.io/projected/f74b295a-b2ad-47f5-ba11-aa1822b921ca-kube-api-access-pj65k\") pod \"kuadrant-operator-catalog-n4cw6\" (UID: \"f74b295a-b2ad-47f5-ba11-aa1822b921ca\") " pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:56:53.941441 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.941406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj65k\" (UniqueName: \"kubernetes.io/projected/f74b295a-b2ad-47f5-ba11-aa1822b921ca-kube-api-access-pj65k\") pod \"kuadrant-operator-catalog-n4cw6\" (UID: \"f74b295a-b2ad-47f5-ba11-aa1822b921ca\") " pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:56:53.951767 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:53.951741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj65k\" (UniqueName: \"kubernetes.io/projected/f74b295a-b2ad-47f5-ba11-aa1822b921ca-kube-api-access-pj65k\") pod \"kuadrant-operator-catalog-n4cw6\" (UID: \"f74b295a-b2ad-47f5-ba11-aa1822b921ca\") " pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:56:54.075570 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:54.075481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:56:54.217844 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:54.217823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n4cw6"] Jun 06 13:56:54.220204 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:56:54.220177 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74b295a_b2ad_47f5_ba11_aa1822b921ca.slice/crio-62d32411178e90903ad39072e2f5d802531dcd0b95b7a7331e54a110e2695034 WatchSource:0}: Error finding container 62d32411178e90903ad39072e2f5d802531dcd0b95b7a7331e54a110e2695034: Status 404 returned error can't find the container with id 62d32411178e90903ad39072e2f5d802531dcd0b95b7a7331e54a110e2695034 Jun 06 13:56:54.260247 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:54.260216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" event={"ID":"693b5e26-98f2-4052-acad-46affc8c55eb","Type":"ContainerStarted","Data":"8e549ae192c24b3084f5a5e971f94d5016e7a12e736f56645cd76e6d9acb35ba"} Jun 06 13:56:54.261364 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:54.261338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" event={"ID":"f74b295a-b2ad-47f5-ba11-aa1822b921ca","Type":"ContainerStarted","Data":"62d32411178e90903ad39072e2f5d802531dcd0b95b7a7331e54a110e2695034"} Jun 06 13:56:56.273714 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.273680 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" event={"ID":"693b5e26-98f2-4052-acad-46affc8c55eb","Type":"ContainerStarted","Data":"aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680"} Jun 06 13:56:56.274190 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.273732 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" podUID="693b5e26-98f2-4052-acad-46affc8c55eb" containerName="registry-server" containerID="cri-o://aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680" gracePeriod=2 Jun 06 13:56:56.275298 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.275269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" event={"ID":"f74b295a-b2ad-47f5-ba11-aa1822b921ca","Type":"ContainerStarted","Data":"67f788ffa206aa12053bda3aa0ea86ccc5e18055563fea7bccdd9d2e273df575"} Jun 06 13:56:56.288851 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.288809 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" podStartSLOduration=1.140601678 podStartE2EDuration="3.28879353s" totalImagesPullingTime="2.148191852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:56:56.287347874 +0000 UTC m=+512.615887542" watchObservedRunningTime="2026-06-06 13:56:56.28879353 +0000 UTC m=+512.617333197" Jun 06 13:56:56.301074 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.301004 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" podStartSLOduration=1.7267210610000001 podStartE2EDuration="3.300995332s" totalImagesPullingTime="1.574274271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:56:56.300449285 +0000 UTC m=+512.628988974" watchObservedRunningTime="2026-06-06 13:56:56.300995332 +0000 UTC m=+512.629534997" Jun 06 13:56:56.524512 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.524452 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" Jun 06 13:56:56.666635 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.666603 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm6xl\" (UniqueName: \"kubernetes.io/projected/693b5e26-98f2-4052-acad-46affc8c55eb-kube-api-access-zm6xl\") pod \"693b5e26-98f2-4052-acad-46affc8c55eb\" (UID: \"693b5e26-98f2-4052-acad-46affc8c55eb\") " Jun 06 13:56:56.668751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.668722 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693b5e26-98f2-4052-acad-46affc8c55eb-kube-api-access-zm6xl" (OuterVolumeSpecName: "kube-api-access-zm6xl") pod "693b5e26-98f2-4052-acad-46affc8c55eb" (UID: "693b5e26-98f2-4052-acad-46affc8c55eb"). InnerVolumeSpecName "kube-api-access-zm6xl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:56:56.768126 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:56.768089 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm6xl\" (UniqueName: \"kubernetes.io/projected/693b5e26-98f2-4052-acad-46affc8c55eb-kube-api-access-zm6xl\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:56:57.280762 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.280733 2578 generic.go:356] "Generic (PLEG): container finished" podID="693b5e26-98f2-4052-acad-46affc8c55eb" containerID="aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680" exitCode=0 Jun 06 13:56:57.281205 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.280772 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" Jun 06 13:56:57.281205 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.280817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" event={"ID":"693b5e26-98f2-4052-acad-46affc8c55eb","Type":"ContainerDied","Data":"aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680"} Jun 06 13:56:57.281205 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.280861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h9xb8" event={"ID":"693b5e26-98f2-4052-acad-46affc8c55eb","Type":"ContainerDied","Data":"8e549ae192c24b3084f5a5e971f94d5016e7a12e736f56645cd76e6d9acb35ba"} Jun 06 13:56:57.281205 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.280880 2578 scope.go:117] "RemoveContainer" containerID="aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680" Jun 06 13:56:57.290049 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.290011 2578 scope.go:117] "RemoveContainer" containerID="aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680" Jun 06 13:56:57.290298 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:56:57.290280 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680\": container with ID starting with aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680 not found: ID does not exist" containerID="aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680" Jun 06 13:56:57.290349 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.290305 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680"} err="failed to get container status \"aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680\": rpc error: code = NotFound desc = could not find container \"aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680\": container with ID starting with aca902a3c116a8ff7e363019be8a3508dbed2dc913f5f0a0adf5638c340fd680 not found: ID does not exist" Jun 06 13:56:57.300286 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.300264 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h9xb8"] Jun 06 13:56:57.303798 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:57.303773 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h9xb8"] Jun 06 13:56:58.138157 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:56:58.138124 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693b5e26-98f2-4052-acad-46affc8c55eb" path="/var/lib/kubelet/pods/693b5e26-98f2-4052-acad-46affc8c55eb/volumes" Jun 06 13:57:04.075712 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:04.075665 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:57:04.076242 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:04.075735 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:57:04.098303 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:04.098272 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:57:04.342398 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:04.342315 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n4cw6" Jun 06 13:57:25.053266 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.053197 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2"] Jun 06 13:57:25.053664 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.053578 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693b5e26-98f2-4052-acad-46affc8c55eb" containerName="registry-server" Jun 06 13:57:25.053664 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.053588 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="693b5e26-98f2-4052-acad-46affc8c55eb" containerName="registry-server" Jun 06 13:57:25.053744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.053672 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="693b5e26-98f2-4052-acad-46affc8c55eb" containerName="registry-server" Jun 06 13:57:25.056429 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.056408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" Jun 06 13:57:25.059682 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.059655 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 06 13:57:25.059981 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.059961 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tk5lq\"" Jun 06 13:57:25.078744 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.078719 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2"] Jun 06 13:57:25.127868 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.127829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt99d\" (UniqueName: \"kubernetes.io/projected/8feb7b32-8d5b-4d24-ac99-038f5b495be8-kube-api-access-xt99d\") pod \"dns-operator-controller-manager-864dd78c4c-nhfs2\" (UID: \"8feb7b32-8d5b-4d24-ac99-038f5b495be8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" Jun 06 13:57:25.228887 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.228856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt99d\" (UniqueName: \"kubernetes.io/projected/8feb7b32-8d5b-4d24-ac99-038f5b495be8-kube-api-access-xt99d\") pod \"dns-operator-controller-manager-864dd78c4c-nhfs2\" (UID: \"8feb7b32-8d5b-4d24-ac99-038f5b495be8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" Jun 06 13:57:25.238329 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.238298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt99d\" (UniqueName: \"kubernetes.io/projected/8feb7b32-8d5b-4d24-ac99-038f5b495be8-kube-api-access-xt99d\") pod \"dns-operator-controller-manager-864dd78c4c-nhfs2\" (UID: \"8feb7b32-8d5b-4d24-ac99-038f5b495be8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" Jun 06 13:57:25.366652 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.366613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" Jun 06 13:57:25.517930 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:25.517903 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2"] Jun 06 13:57:25.520667 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:57:25.520640 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8feb7b32_8d5b_4d24_ac99_038f5b495be8.slice/crio-c7e3ed12526a9d2f6c835288d137e34dc5c09cb11869c79a13bd7d15f09a92c4 WatchSource:0}: Error finding container c7e3ed12526a9d2f6c835288d137e34dc5c09cb11869c79a13bd7d15f09a92c4: Status 404 returned error can't find the container with id c7e3ed12526a9d2f6c835288d137e34dc5c09cb11869c79a13bd7d15f09a92c4 Jun 06 13:57:26.428177 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:26.428136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" event={"ID":"8feb7b32-8d5b-4d24-ac99-038f5b495be8","Type":"ContainerStarted","Data":"c7e3ed12526a9d2f6c835288d137e34dc5c09cb11869c79a13bd7d15f09a92c4"} Jun 06 13:57:28.440675 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:28.440630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" event={"ID":"8feb7b32-8d5b-4d24-ac99-038f5b495be8","Type":"ContainerStarted","Data":"09d0f472aad4dfb8493c2b151eff768d6733d321c3dab8a71f823709f14026ca"} Jun 06 13:57:28.441065 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:28.440707 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" Jun 06 13:57:28.459596 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:28.459539 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" podStartSLOduration=1.48852066 podStartE2EDuration="3.459518286s" totalImagesPullingTime="1.970997626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:57:28.45816412 +0000 UTC m=+544.786703788" watchObservedRunningTime="2026-06-06 13:57:28.459518286 +0000 UTC m=+544.788057955" Jun 06 13:57:29.679366 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.679331 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl"] Jun 06 13:57:29.684034 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.683998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:29.686495 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.686471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hqzwx\"" Jun 06 13:57:29.700703 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.700677 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl"] Jun 06 13:57:29.780034 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.779992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28a5668-5830-4171-a365-9e4384b19a7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:29.780200 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.780170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkg5g\" (UniqueName: \"kubernetes.io/projected/d28a5668-5830-4171-a365-9e4384b19a7e-kube-api-access-gkg5g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:29.881474 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.881437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28a5668-5830-4171-a365-9e4384b19a7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:29.881653 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.881507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkg5g\" (UniqueName: \"kubernetes.io/projected/d28a5668-5830-4171-a365-9e4384b19a7e-kube-api-access-gkg5g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:29.881837 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.881816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28a5668-5830-4171-a365-9e4384b19a7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:29.892468 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.892432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkg5g\" (UniqueName: \"kubernetes.io/projected/d28a5668-5830-4171-a365-9e4384b19a7e-kube-api-access-gkg5g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:29.993667 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:29.993577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:30.139157 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:57:30.139116 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28a5668_5830_4171_a365_9e4384b19a7e.slice/crio-24be10d3145dbdb3f234c0aa728d0f09e361e2f47905a613e4ef55e6002b1f1f WatchSource:0}: Error finding container 24be10d3145dbdb3f234c0aa728d0f09e361e2f47905a613e4ef55e6002b1f1f: Status 404 returned error can't find the container with id 24be10d3145dbdb3f234c0aa728d0f09e361e2f47905a613e4ef55e6002b1f1f Jun 06 13:57:30.139597 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:30.139573 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl"] Jun 06 13:57:30.451892 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:30.451858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" event={"ID":"d28a5668-5830-4171-a365-9e4384b19a7e","Type":"ContainerStarted","Data":"24be10d3145dbdb3f234c0aa728d0f09e361e2f47905a613e4ef55e6002b1f1f"} Jun 06 13:57:34.476667 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:34.476629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" event={"ID":"d28a5668-5830-4171-a365-9e4384b19a7e","Type":"ContainerStarted","Data":"1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9"} Jun 06 13:57:34.477120 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:34.476806 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:34.501109 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:34.501049 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" podStartSLOduration=1.371486044 podStartE2EDuration="5.50101246s" totalImagesPullingTime="4.129526416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:57:34.499518713 +0000 UTC m=+550.828058383" watchObservedRunningTime="2026-06-06 13:57:34.50101246 +0000 UTC m=+550.829552130" Jun 06 13:57:36.317875 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.317840 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-22vlw"] Jun 06 13:57:36.320513 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.320496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" Jun 06 13:57:36.324318 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.324299 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bfbf4\"" Jun 06 13:57:36.333128 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.333100 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-22vlw"] Jun 06 13:57:36.447266 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.447202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bldng\" (UniqueName: \"kubernetes.io/projected/66e01c02-5a3c-41b9-b513-308e8d9ca58f-kube-api-access-bldng\") pod \"authorino-operator-75cc8d5cb7-22vlw\" (UID: \"66e01c02-5a3c-41b9-b513-308e8d9ca58f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" Jun 06 13:57:36.547786 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.547740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bldng\" (UniqueName: \"kubernetes.io/projected/66e01c02-5a3c-41b9-b513-308e8d9ca58f-kube-api-access-bldng\") pod \"authorino-operator-75cc8d5cb7-22vlw\" (UID: \"66e01c02-5a3c-41b9-b513-308e8d9ca58f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" Jun 06 13:57:36.555581 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.555555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bldng\" (UniqueName: \"kubernetes.io/projected/66e01c02-5a3c-41b9-b513-308e8d9ca58f-kube-api-access-bldng\") pod \"authorino-operator-75cc8d5cb7-22vlw\" (UID: \"66e01c02-5a3c-41b9-b513-308e8d9ca58f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" Jun 06 13:57:36.630367 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.630341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" Jun 06 13:57:36.766087 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:36.766061 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-22vlw"] Jun 06 13:57:36.769383 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:57:36.769349 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e01c02_5a3c_41b9_b513_308e8d9ca58f.slice/crio-2f922849c5c06f981756dfbb69eb0948477160604f8cc8fc7b54142243c7b65e WatchSource:0}: Error finding container 2f922849c5c06f981756dfbb69eb0948477160604f8cc8fc7b54142243c7b65e: Status 404 returned error can't find the container with id 2f922849c5c06f981756dfbb69eb0948477160604f8cc8fc7b54142243c7b65e Jun 06 13:57:37.494588 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:37.494526 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" event={"ID":"66e01c02-5a3c-41b9-b513-308e8d9ca58f","Type":"ContainerStarted","Data":"2f922849c5c06f981756dfbb69eb0948477160604f8cc8fc7b54142243c7b65e"} Jun 06 13:57:39.448622 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:39.448588 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nhfs2" Jun 06 13:57:39.506846 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:39.506804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" event={"ID":"66e01c02-5a3c-41b9-b513-308e8d9ca58f","Type":"ContainerStarted","Data":"3c68aa51a1a1f0f84a955a1f23950fb88c5788561b95c093afdb195dba14a6d1"} Jun 06 13:57:39.507065 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:39.506869 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" Jun 06 13:57:39.523757 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:39.523699 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" podStartSLOduration=1.382644354 podStartE2EDuration="3.523682674s" totalImagesPullingTime="2.14103832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:57:39.521398439 +0000 UTC m=+555.849938108" watchObservedRunningTime="2026-06-06 13:57:39.523682674 +0000 UTC m=+555.852222341" Jun 06 13:57:45.484407 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:45.484372 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:46.513344 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.513305 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt"] Jun 06 13:57:46.516839 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.516820 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.527963 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.527941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt"] Jun 06 13:57:46.646321 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.646282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a528f45a-a2d7-4351-a65f-5f2d02e23992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.646321 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.646319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58fbw\" (UniqueName: \"kubernetes.io/projected/a528f45a-a2d7-4351-a65f-5f2d02e23992-kube-api-access-58fbw\") pod \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.747001 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.746969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a528f45a-a2d7-4351-a65f-5f2d02e23992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.747001 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.747003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58fbw\" (UniqueName: \"kubernetes.io/projected/a528f45a-a2d7-4351-a65f-5f2d02e23992-kube-api-access-58fbw\") pod \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.747362 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.747342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a528f45a-a2d7-4351-a65f-5f2d02e23992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.754906 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.754877 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58fbw\" (UniqueName: \"kubernetes.io/projected/a528f45a-a2d7-4351-a65f-5f2d02e23992-kube-api-access-58fbw\") pod \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.828149 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.828052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:46.964485 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:46.964452 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt"] Jun 06 13:57:46.967773 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:57:46.967747 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda528f45a_a2d7_4351_a65f_5f2d02e23992.slice/crio-d851fe08e980fd99fe21d3a970628d07b7cb825af6cb2f678586de249f0410c1 WatchSource:0}: Error finding container d851fe08e980fd99fe21d3a970628d07b7cb825af6cb2f678586de249f0410c1: Status 404 returned error can't find the container with id d851fe08e980fd99fe21d3a970628d07b7cb825af6cb2f678586de249f0410c1 Jun 06 13:57:47.043051 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.043009 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt"] Jun 06 13:57:47.051508 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.051485 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt"] Jun 06 13:57:47.066415 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.066381 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl"] Jun 06 13:57:47.066636 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.066609 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" containerName="manager" containerID="cri-o://1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9" gracePeriod=2 Jun 06 13:57:47.068270 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.068241 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx"] Jun 06 13:57:47.068784 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.068762 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" containerName="manager" Jun 06 13:57:47.068784 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.068786 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" containerName="manager" Jun 06 13:57:47.068935 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.068873 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" containerName="manager" Jun 06 13:57:47.072312 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.072292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.077443 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.077419 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl"] Jun 06 13:57:47.085531 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.085510 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx"] Jun 06 13:57:47.090738 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.090701 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d28a5668-5830-4171-a365-9e4384b19a7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xhltl\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.092768 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.092748 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855"] Jun 06 13:57:47.093184 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.093170 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" containerName="manager" Jun 06 13:57:47.093233 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.093185 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" containerName="manager" Jun 06 13:57:47.093267 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.093259 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" containerName="manager" Jun 06 13:57:47.096336 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.096318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.112880 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.112849 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855"] Jun 06 13:57:47.116820 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.116793 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.120361 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.120335 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.251716 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.251683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48411b0-3855-4f84-9f0e-15529e74f8fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cnmsx\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.251866 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.251720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hdwc\" (UniqueName: \"kubernetes.io/projected/9774ec01-dbb4-46b1-97f4-53002b5d55f3-kube-api-access-7hdwc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dn855\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.251937 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.251862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7s6c\" (UniqueName: \"kubernetes.io/projected/a48411b0-3855-4f84-9f0e-15529e74f8fd-kube-api-access-c7s6c\") pod \"kuadrant-operator-controller-manager-55467d9f7-cnmsx\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.251994 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.251938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9774ec01-dbb4-46b1-97f4-53002b5d55f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dn855\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.302195 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.302169 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.304499 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.304475 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.352923 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.352837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7s6c\" (UniqueName: \"kubernetes.io/projected/a48411b0-3855-4f84-9f0e-15529e74f8fd-kube-api-access-c7s6c\") pod \"kuadrant-operator-controller-manager-55467d9f7-cnmsx\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.352923 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.352887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9774ec01-dbb4-46b1-97f4-53002b5d55f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dn855\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.353173 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.352939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48411b0-3855-4f84-9f0e-15529e74f8fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cnmsx\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.353173 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.352956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hdwc\" (UniqueName: \"kubernetes.io/projected/9774ec01-dbb4-46b1-97f4-53002b5d55f3-kube-api-access-7hdwc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dn855\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.353399 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.353376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9774ec01-dbb4-46b1-97f4-53002b5d55f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dn855\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.353443 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.353388 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48411b0-3855-4f84-9f0e-15529e74f8fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cnmsx\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.362938 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.362906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7s6c\" (UniqueName: \"kubernetes.io/projected/a48411b0-3855-4f84-9f0e-15529e74f8fd-kube-api-access-c7s6c\") pod \"kuadrant-operator-controller-manager-55467d9f7-cnmsx\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.363353 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.363331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hdwc\" (UniqueName: \"kubernetes.io/projected/9774ec01-dbb4-46b1-97f4-53002b5d55f3-kube-api-access-7hdwc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dn855\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.388215 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.388190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:47.447228 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.446966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:47.453451 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.453427 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28a5668-5830-4171-a365-9e4384b19a7e-extensions-socket-volume\") pod \"d28a5668-5830-4171-a365-9e4384b19a7e\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " Jun 06 13:57:47.453552 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.453537 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkg5g\" (UniqueName: \"kubernetes.io/projected/d28a5668-5830-4171-a365-9e4384b19a7e-kube-api-access-gkg5g\") pod \"d28a5668-5830-4171-a365-9e4384b19a7e\" (UID: \"d28a5668-5830-4171-a365-9e4384b19a7e\") " Jun 06 13:57:47.454083 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.454055 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28a5668-5830-4171-a365-9e4384b19a7e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d28a5668-5830-4171-a365-9e4384b19a7e" (UID: "d28a5668-5830-4171-a365-9e4384b19a7e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:57:47.455519 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.455477 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28a5668-5830-4171-a365-9e4384b19a7e-kube-api-access-gkg5g" (OuterVolumeSpecName: "kube-api-access-gkg5g") pod "d28a5668-5830-4171-a365-9e4384b19a7e" (UID: "d28a5668-5830-4171-a365-9e4384b19a7e"). InnerVolumeSpecName "kube-api-access-gkg5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:57:47.533983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.533957 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx"] Jun 06 13:57:47.537470 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:57:47.537439 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48411b0_3855_4f84_9f0e_15529e74f8fd.slice/crio-dc5200df05d8bc55b8d401cff879ffbefb2ea29fb488241a183c96e1c2a8db4a WatchSource:0}: Error finding container dc5200df05d8bc55b8d401cff879ffbefb2ea29fb488241a183c96e1c2a8db4a: Status 404 returned error can't find the container with id dc5200df05d8bc55b8d401cff879ffbefb2ea29fb488241a183c96e1c2a8db4a Jun 06 13:57:47.549403 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.549378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" event={"ID":"a48411b0-3855-4f84-9f0e-15529e74f8fd","Type":"ContainerStarted","Data":"dc5200df05d8bc55b8d401cff879ffbefb2ea29fb488241a183c96e1c2a8db4a"} Jun 06 13:57:47.551496 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.551468 2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" container="manager" Jun 06 13:57:47.553007 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.552982 2578 generic.go:356] "Generic (PLEG): container finished" podID="d28a5668-5830-4171-a365-9e4384b19a7e" containerID="1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9" exitCode=0 Jun 06 13:57:47.553134 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.553121 2578 scope.go:117] "RemoveContainer" containerID="1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9" Jun 06 13:57:47.553275 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.553260 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.553831 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.553689 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.554535 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.554486 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkg5g\" (UniqueName: \"kubernetes.io/projected/d28a5668-5830-4171-a365-9e4384b19a7e-kube-api-access-gkg5g\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:57:47.554535 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.554513 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d28a5668-5830-4171-a365-9e4384b19a7e-extensions-socket-volume\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:57:47.558348 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.558099 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:47.560211 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.560081 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.561939 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.561851 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:47.564561 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.564468 2578 scope.go:117] "RemoveContainer" containerID="1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9" Jun 06 13:57:47.564983 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.564918 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9\": container with ID starting with 1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9 not found: ID does not exist" containerID="1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9" Jun 06 13:57:47.564983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.564956 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9"} err="failed to get container status \"1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9\": rpc error: code = NotFound desc = could not find container \"1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9\": container with ID starting with 1805a23791aa4d5ea33b4e02a310b635fd317570b7289e010e5dff716bc557d9 not found: ID does not exist" Jun 06 13:57:47.568237 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.568211 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:47.570104 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:47.570077 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xhltl\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhltl" Jun 06 13:57:47.605010 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:47.604947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855"] Jun 06 13:57:47.608416 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:57:47.608387 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9774ec01_dbb4_46b1_97f4_53002b5d55f3.slice/crio-2b0c8899ec8eb8d377e0c3e64fee115bf347b343fd9a98185814b65a2ddd375f WatchSource:0}: Error finding container 2b0c8899ec8eb8d377e0c3e64fee115bf347b343fd9a98185814b65a2ddd375f: Status 404 returned error can't find the container with id 2b0c8899ec8eb8d377e0c3e64fee115bf347b343fd9a98185814b65a2ddd375f Jun 06 13:57:48.140879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.140845 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28a5668-5830-4171-a365-9e4384b19a7e" path="/var/lib/kubelet/pods/d28a5668-5830-4171-a365-9e4384b19a7e/volumes" Jun 06 13:57:48.559554 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.559443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" event={"ID":"a48411b0-3855-4f84-9f0e-15529e74f8fd","Type":"ContainerStarted","Data":"29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d"} Jun 06 13:57:48.559983 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.559597 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:48.561274 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.561237 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" containerName="manager" containerID="cri-o://0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c" gracePeriod=2 Jun 06 13:57:48.562751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.562728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" event={"ID":"9774ec01-dbb4-46b1-97f4-53002b5d55f3","Type":"ContainerStarted","Data":"428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04"} Jun 06 13:57:48.562879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.562772 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:48.562879 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.562789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" event={"ID":"9774ec01-dbb4-46b1-97f4-53002b5d55f3","Type":"ContainerStarted","Data":"2b0c8899ec8eb8d377e0c3e64fee115bf347b343fd9a98185814b65a2ddd375f"} Jun 06 13:57:48.591667 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.591627 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" podStartSLOduration=1.591610439 podStartE2EDuration="1.591610439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:57:48.589563322 +0000 UTC m=+564.918103002" watchObservedRunningTime="2026-06-06 13:57:48.591610439 +0000 UTC m=+564.920150106" Jun 06 13:57:48.611497 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.611457 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" podStartSLOduration=1.6114429220000002 podStartE2EDuration="1.611442922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:57:48.609286171 +0000 UTC m=+564.937825861" watchObservedRunningTime="2026-06-06 13:57:48.611442922 +0000 UTC m=+564.939982589" Jun 06 13:57:48.809613 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.809547 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:48.811806 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:48.811769 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:48.967559 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.967532 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58fbw\" (UniqueName: \"kubernetes.io/projected/a528f45a-a2d7-4351-a65f-5f2d02e23992-kube-api-access-58fbw\") pod \"a528f45a-a2d7-4351-a65f-5f2d02e23992\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " Jun 06 13:57:48.967698 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.967576 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a528f45a-a2d7-4351-a65f-5f2d02e23992-extensions-socket-volume\") pod \"a528f45a-a2d7-4351-a65f-5f2d02e23992\" (UID: \"a528f45a-a2d7-4351-a65f-5f2d02e23992\") " Jun 06 13:57:48.967917 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.967885 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a528f45a-a2d7-4351-a65f-5f2d02e23992-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a528f45a-a2d7-4351-a65f-5f2d02e23992" (UID: "a528f45a-a2d7-4351-a65f-5f2d02e23992"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:57:48.969544 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:48.969516 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a528f45a-a2d7-4351-a65f-5f2d02e23992-kube-api-access-58fbw" (OuterVolumeSpecName: "kube-api-access-58fbw") pod "a528f45a-a2d7-4351-a65f-5f2d02e23992" (UID: "a528f45a-a2d7-4351-a65f-5f2d02e23992"). InnerVolumeSpecName "kube-api-access-58fbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:57:49.069188 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:49.069107 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58fbw\" (UniqueName: \"kubernetes.io/projected/a528f45a-a2d7-4351-a65f-5f2d02e23992-kube-api-access-58fbw\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:57:49.069188 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:49.069133 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a528f45a-a2d7-4351-a65f-5f2d02e23992-extensions-socket-volume\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:57:49.570286 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:49.570250 2578 generic.go:356] "Generic (PLEG): container finished" podID="a528f45a-a2d7-4351-a65f-5f2d02e23992" containerID="0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c" exitCode=2 Jun 06 13:57:49.570750 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:49.570294 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:49.570750 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:49.570344 2578 scope.go:117] "RemoveContainer" containerID="0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c" Jun 06 13:57:49.578405 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:49.578361 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:49.584340 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:49.584305 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-jchlt\" is forbidden: User \"system:node:ip-10-0-139-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-222.ec2.internal' and this object" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-jchlt" Jun 06 13:57:49.586918 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:49.586898 2578 scope.go:117] "RemoveContainer" containerID="0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c" Jun 06 13:57:49.589848 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:57:49.589821 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c\": container with ID starting with 0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c not found: ID does not exist" containerID="0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c" Jun 06 13:57:49.589948 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:49.589860 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c"} err="failed to get container status \"0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c\": rpc error: code = NotFound desc = could not find container \"0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c\": container with ID starting with 0aff0739875b83d57e4ec7aba52213660e601ac751beb74d15cf26d799365b1c not found: ID does not exist" Jun 06 13:57:50.138426 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:50.138394 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a528f45a-a2d7-4351-a65f-5f2d02e23992" path="/var/lib/kubelet/pods/a528f45a-a2d7-4351-a65f-5f2d02e23992/volumes" Jun 06 13:57:50.515467 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:50.515383 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-22vlw" Jun 06 13:57:59.573175 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.573141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:59.573556 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.573215 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:57:59.645958 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.645922 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855"] Jun 06 13:57:59.646163 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.646137 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" podUID="9774ec01-dbb4-46b1-97f4-53002b5d55f3" containerName="manager" containerID="cri-o://428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04" gracePeriod=10 Jun 06 13:57:59.858315 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.855427 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk"] Jun 06 13:57:59.880555 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.880524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:57:59.887263 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.887238 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk"] Jun 06 13:57:59.917122 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.917098 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:57:59.980548 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.980523 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9774ec01-dbb4-46b1-97f4-53002b5d55f3-extensions-socket-volume\") pod \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " Jun 06 13:57:59.980703 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.980571 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hdwc\" (UniqueName: \"kubernetes.io/projected/9774ec01-dbb4-46b1-97f4-53002b5d55f3-kube-api-access-7hdwc\") pod \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\" (UID: \"9774ec01-dbb4-46b1-97f4-53002b5d55f3\") " Jun 06 13:57:59.980703 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.980649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpklv\" (UniqueName: \"kubernetes.io/projected/ae2a146e-7f9c-4da1-8793-7fc5787ba0e0-kube-api-access-jpklv\") pod \"kuadrant-operator-controller-manager-86878c769f-wpwkk\" (UID: \"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:57:59.980799 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.980713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2a146e-7f9c-4da1-8793-7fc5787ba0e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wpwkk\" (UID: \"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:57:59.980940 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.980919 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9774ec01-dbb4-46b1-97f4-53002b5d55f3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9774ec01-dbb4-46b1-97f4-53002b5d55f3" (UID: "9774ec01-dbb4-46b1-97f4-53002b5d55f3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:57:59.982729 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:57:59.982707 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9774ec01-dbb4-46b1-97f4-53002b5d55f3-kube-api-access-7hdwc" (OuterVolumeSpecName: "kube-api-access-7hdwc") pod "9774ec01-dbb4-46b1-97f4-53002b5d55f3" (UID: "9774ec01-dbb4-46b1-97f4-53002b5d55f3"). InnerVolumeSpecName "kube-api-access-7hdwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:58:00.081428 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.081399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpklv\" (UniqueName: \"kubernetes.io/projected/ae2a146e-7f9c-4da1-8793-7fc5787ba0e0-kube-api-access-jpklv\") pod \"kuadrant-operator-controller-manager-86878c769f-wpwkk\" (UID: \"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:58:00.081568 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.081447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2a146e-7f9c-4da1-8793-7fc5787ba0e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wpwkk\" (UID: \"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:58:00.081568 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.081521 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hdwc\" (UniqueName: \"kubernetes.io/projected/9774ec01-dbb4-46b1-97f4-53002b5d55f3-kube-api-access-7hdwc\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:58:00.081568 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.081536 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9774ec01-dbb4-46b1-97f4-53002b5d55f3-extensions-socket-volume\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:58:00.081846 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.081828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2a146e-7f9c-4da1-8793-7fc5787ba0e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wpwkk\" (UID: \"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:58:00.089271 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.089244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpklv\" (UniqueName: \"kubernetes.io/projected/ae2a146e-7f9c-4da1-8793-7fc5787ba0e0-kube-api-access-jpklv\") pod \"kuadrant-operator-controller-manager-86878c769f-wpwkk\" (UID: \"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:58:00.194541 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.194516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:58:00.336737 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.336712 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk"] Jun 06 13:58:00.338993 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:58:00.338961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2a146e_7f9c_4da1_8793_7fc5787ba0e0.slice/crio-309cc21e00650a98f01b37f83d0ed0312222e68b795b2d8f10c7e91e38e9dd8a WatchSource:0}: Error finding container 309cc21e00650a98f01b37f83d0ed0312222e68b795b2d8f10c7e91e38e9dd8a: Status 404 returned error can't find the container with id 309cc21e00650a98f01b37f83d0ed0312222e68b795b2d8f10c7e91e38e9dd8a Jun 06 13:58:00.629563 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.629528 2578 generic.go:356] "Generic (PLEG): container finished" podID="9774ec01-dbb4-46b1-97f4-53002b5d55f3" containerID="428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04" exitCode=0 Jun 06 13:58:00.629995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.629581 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" Jun 06 13:58:00.629995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.629607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" event={"ID":"9774ec01-dbb4-46b1-97f4-53002b5d55f3","Type":"ContainerDied","Data":"428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04"} Jun 06 13:58:00.629995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.629655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855" event={"ID":"9774ec01-dbb4-46b1-97f4-53002b5d55f3","Type":"ContainerDied","Data":"2b0c8899ec8eb8d377e0c3e64fee115bf347b343fd9a98185814b65a2ddd375f"} Jun 06 13:58:00.629995 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.629684 2578 scope.go:117] "RemoveContainer" containerID="428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04" Jun 06 13:58:00.631692 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.631662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" event={"ID":"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0","Type":"ContainerStarted","Data":"7bd63650c4cdd50d832717afbe11c76f93047d16d9db30e053d3d8501821eb25"} Jun 06 13:58:00.631810 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.631716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" event={"ID":"ae2a146e-7f9c-4da1-8793-7fc5787ba0e0","Type":"ContainerStarted","Data":"309cc21e00650a98f01b37f83d0ed0312222e68b795b2d8f10c7e91e38e9dd8a"} Jun 06 13:58:00.631810 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.631766 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:58:00.638902 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.638884 2578 scope.go:117] "RemoveContainer" containerID="428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04" Jun 06 13:58:00.639284 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:58:00.639261 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04\": container with ID starting with 428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04 not found: ID does not exist" containerID="428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04" Jun 06 13:58:00.639372 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.639296 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04"} err="failed to get container status \"428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04\": rpc error: code = NotFound desc = could not find container \"428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04\": container with ID starting with 428a49d813088d9c6333fa689a602c61ac9e5464df4ce2b6d86923f4c1ae0f04 not found: ID does not exist" Jun 06 13:58:00.652502 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.652469 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855"] Jun 06 13:58:00.657056 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.657016 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dn855"] Jun 06 13:58:00.674977 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:00.674922 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" podStartSLOduration=1.674904002 podStartE2EDuration="1.674904002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:58:00.672745231 +0000 UTC m=+577.001284899" watchObservedRunningTime="2026-06-06 13:58:00.674904002 +0000 UTC m=+577.003443670" Jun 06 13:58:02.139124 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:02.139088 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9774ec01-dbb4-46b1-97f4-53002b5d55f3" path="/var/lib/kubelet/pods/9774ec01-dbb4-46b1-97f4-53002b5d55f3/volumes" Jun 06 13:58:11.640694 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:11.640663 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wpwkk" Jun 06 13:58:11.699169 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:11.699117 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx"] Jun 06 13:58:11.699408 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:11.699383 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" podUID="a48411b0-3855-4f84-9f0e-15529e74f8fd" containerName="manager" containerID="cri-o://29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d" gracePeriod=10 Jun 06 13:58:11.957656 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:11.957632 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:58:12.094254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.094214 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7s6c\" (UniqueName: \"kubernetes.io/projected/a48411b0-3855-4f84-9f0e-15529e74f8fd-kube-api-access-c7s6c\") pod \"a48411b0-3855-4f84-9f0e-15529e74f8fd\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " Jun 06 13:58:12.094434 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.094377 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48411b0-3855-4f84-9f0e-15529e74f8fd-extensions-socket-volume\") pod \"a48411b0-3855-4f84-9f0e-15529e74f8fd\" (UID: \"a48411b0-3855-4f84-9f0e-15529e74f8fd\") " Jun 06 13:58:12.094776 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.094748 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48411b0-3855-4f84-9f0e-15529e74f8fd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a48411b0-3855-4f84-9f0e-15529e74f8fd" (UID: "a48411b0-3855-4f84-9f0e-15529e74f8fd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:58:12.096429 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.096403 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48411b0-3855-4f84-9f0e-15529e74f8fd-kube-api-access-c7s6c" (OuterVolumeSpecName: "kube-api-access-c7s6c") pod "a48411b0-3855-4f84-9f0e-15529e74f8fd" (UID: "a48411b0-3855-4f84-9f0e-15529e74f8fd"). InnerVolumeSpecName "kube-api-access-c7s6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:58:12.196254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.196163 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48411b0-3855-4f84-9f0e-15529e74f8fd-extensions-socket-volume\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:58:12.196254 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.196191 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7s6c\" (UniqueName: \"kubernetes.io/projected/a48411b0-3855-4f84-9f0e-15529e74f8fd-kube-api-access-c7s6c\") on node \"ip-10-0-139-222.ec2.internal\" DevicePath \"\"" Jun 06 13:58:12.693483 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.693449 2578 generic.go:356] "Generic (PLEG): container finished" podID="a48411b0-3855-4f84-9f0e-15529e74f8fd" containerID="29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d" exitCode=0 Jun 06 13:58:12.693886 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.693495 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" Jun 06 13:58:12.693886 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.693515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" event={"ID":"a48411b0-3855-4f84-9f0e-15529e74f8fd","Type":"ContainerDied","Data":"29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d"} Jun 06 13:58:12.693886 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.693558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx" event={"ID":"a48411b0-3855-4f84-9f0e-15529e74f8fd","Type":"ContainerDied","Data":"dc5200df05d8bc55b8d401cff879ffbefb2ea29fb488241a183c96e1c2a8db4a"} Jun 06 13:58:12.693886 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.693580 2578 scope.go:117] "RemoveContainer" containerID="29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d" Jun 06 13:58:12.705234 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.705094 2578 scope.go:117] "RemoveContainer" containerID="29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d" Jun 06 13:58:12.705383 ip-10-0-139-222 kubenswrapper[2578]: E0606 13:58:12.705362 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d\": container with ID starting with 29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d not found: ID does not exist" containerID="29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d" Jun 06 13:58:12.705424 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.705395 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d"} err="failed to get container status \"29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d\": rpc error: code = NotFound desc = could not find container \"29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d\": container with ID starting with 29bd4049dcdbbcf8857078789f38a7205ba84d6f096d091be5ac3a4cbe46b06d not found: ID does not exist" Jun 06 13:58:12.711931 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.711909 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx"] Jun 06 13:58:12.715104 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:12.715081 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cnmsx"] Jun 06 13:58:14.137821 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:14.137789 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a48411b0-3855-4f84-9f0e-15529e74f8fd" path="/var/lib/kubelet/pods/a48411b0-3855-4f84-9f0e-15529e74f8fd/volumes" Jun 06 13:58:16.328951 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.328920 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f"] Jun 06 13:58:16.329536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.329511 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48411b0-3855-4f84-9f0e-15529e74f8fd" containerName="manager" Jun 06 13:58:16.329536 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.329533 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48411b0-3855-4f84-9f0e-15529e74f8fd" containerName="manager" Jun 06 13:58:16.329751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.329544 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9774ec01-dbb4-46b1-97f4-53002b5d55f3" containerName="manager" Jun 06 13:58:16.329751 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.329553 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9774ec01-dbb4-46b1-97f4-53002b5d55f3" containerName="manager" Jun 06 13:58:16.329893 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.329746 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9774ec01-dbb4-46b1-97f4-53002b5d55f3" containerName="manager" Jun 06 13:58:16.329893 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.329800 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a48411b0-3855-4f84-9f0e-15529e74f8fd" containerName="manager" Jun 06 13:58:16.334898 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.334873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.337332 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.337310 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wssql\"" Jun 06 13:58:16.347317 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.347294 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f"] Jun 06 13:58:16.445891 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.445849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.445891 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.445896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.446127 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.445979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.446127 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.446041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.446127 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.446107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcxtf\" (UniqueName: \"kubernetes.io/projected/1dffafbc-01fb-4682-846b-8bba7ea19611-kube-api-access-zcxtf\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.446231 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.446137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dffafbc-01fb-4682-846b-8bba7ea19611-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.446231 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.446178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.446306 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.446245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.446306 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.446284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547427 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547427 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcxtf\" (UniqueName: \"kubernetes.io/projected/1dffafbc-01fb-4682-846b-8bba7ea19611-kube-api-access-zcxtf\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dffafbc-01fb-4682-846b-8bba7ea19611-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.547678 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.548080 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.548080 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.547909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.548186 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.548114 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.548292 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.548273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.548347 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.548290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dffafbc-01fb-4682-846b-8bba7ea19611-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.549991 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.549962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.549991 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.549983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.562943 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.562920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dffafbc-01fb-4682-846b-8bba7ea19611-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.563078 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.562939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcxtf\" (UniqueName: \"kubernetes.io/projected/1dffafbc-01fb-4682-846b-8bba7ea19611-kube-api-access-zcxtf\") pod \"maas-default-gateway-openshift-default-687ff6996-77k4f\" (UID: \"1dffafbc-01fb-4682-846b-8bba7ea19611\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.648928 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.648891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:16.795320 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.795208 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f"] Jun 06 13:58:16.798160 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:58:16.798132 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dffafbc_01fb_4682_846b_8bba7ea19611.slice/crio-4a364e4f4a1f2b8c49b5b740ab2b65ad9cb4b5fab621b34ad7977de56646f267 WatchSource:0}: Error finding container 4a364e4f4a1f2b8c49b5b740ab2b65ad9cb4b5fab621b34ad7977de56646f267: Status 404 returned error can't find the container with id 4a364e4f4a1f2b8c49b5b740ab2b65ad9cb4b5fab621b34ad7977de56646f267 Jun 06 13:58:16.800437 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.800400 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 13:58:16.800515 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.800471 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 13:58:16.800515 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:16.800500 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 13:58:17.726786 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:17.726746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" event={"ID":"1dffafbc-01fb-4682-846b-8bba7ea19611","Type":"ContainerStarted","Data":"fe42fd9ff8a139c7d6481177c095082522968023798c9b6966dcec8abdcfbf06"} Jun 06 13:58:17.727238 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:17.726804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" event={"ID":"1dffafbc-01fb-4682-846b-8bba7ea19611","Type":"ContainerStarted","Data":"4a364e4f4a1f2b8c49b5b740ab2b65ad9cb4b5fab621b34ad7977de56646f267"} Jun 06 13:58:17.749833 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:17.749783 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" podStartSLOduration=1.7497673759999999 podStartE2EDuration="1.749767376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:58:17.746883569 +0000 UTC m=+594.075423248" watchObservedRunningTime="2026-06-06 13:58:17.749767376 +0000 UTC m=+594.078307043" Jun 06 13:58:18.649653 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:18.649614 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:18.654697 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:18.654669 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:18.732538 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:18.732509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:18.733453 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:18.733436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 13:58:32.106410 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.106369 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 13:58:32.109706 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.109684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.112270 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.112253 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 13:58:32.112385 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.112365 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tdj5k\"" Jun 06 13:58:32.117332 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.117293 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 13:58:32.129196 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.129177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 13:58:32.194408 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.194374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/149c5aed-046d-4dd7-845e-2dc6c12452fb-config-file\") pod \"limitador-limitador-54d6d988d5-sp25n\" (UID: \"149c5aed-046d-4dd7-845e-2dc6c12452fb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.194593 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.194563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfm2d\" (UniqueName: \"kubernetes.io/projected/149c5aed-046d-4dd7-845e-2dc6c12452fb-kube-api-access-pfm2d\") pod \"limitador-limitador-54d6d988d5-sp25n\" (UID: \"149c5aed-046d-4dd7-845e-2dc6c12452fb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.295872 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.295833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfm2d\" (UniqueName: \"kubernetes.io/projected/149c5aed-046d-4dd7-845e-2dc6c12452fb-kube-api-access-pfm2d\") pod \"limitador-limitador-54d6d988d5-sp25n\" (UID: \"149c5aed-046d-4dd7-845e-2dc6c12452fb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.296089 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.295890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/149c5aed-046d-4dd7-845e-2dc6c12452fb-config-file\") pod \"limitador-limitador-54d6d988d5-sp25n\" (UID: \"149c5aed-046d-4dd7-845e-2dc6c12452fb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.296525 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.296506 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/149c5aed-046d-4dd7-845e-2dc6c12452fb-config-file\") pod \"limitador-limitador-54d6d988d5-sp25n\" (UID: \"149c5aed-046d-4dd7-845e-2dc6c12452fb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.303079 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.303055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfm2d\" (UniqueName: \"kubernetes.io/projected/149c5aed-046d-4dd7-845e-2dc6c12452fb-kube-api-access-pfm2d\") pod \"limitador-limitador-54d6d988d5-sp25n\" (UID: \"149c5aed-046d-4dd7-845e-2dc6c12452fb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.422327 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.422290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:32.552142 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.552117 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 13:58:32.554276 ip-10-0-139-222 kubenswrapper[2578]: W0606 13:58:32.554227 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149c5aed_046d_4dd7_845e_2dc6c12452fb.slice/crio-c9cf6ac2ff09901640a8f8339f1962e88dd09b52f29b3cce97f2a7de32736e3b WatchSource:0}: Error finding container c9cf6ac2ff09901640a8f8339f1962e88dd09b52f29b3cce97f2a7de32736e3b: Status 404 returned error can't find the container with id c9cf6ac2ff09901640a8f8339f1962e88dd09b52f29b3cce97f2a7de32736e3b Jun 06 13:58:32.809752 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:32.809665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" event={"ID":"149c5aed-046d-4dd7-845e-2dc6c12452fb","Type":"ContainerStarted","Data":"c9cf6ac2ff09901640a8f8339f1962e88dd09b52f29b3cce97f2a7de32736e3b"} Jun 06 13:58:35.825658 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:35.825617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" event={"ID":"149c5aed-046d-4dd7-845e-2dc6c12452fb","Type":"ContainerStarted","Data":"add10b18ad670c0e2879272e5e769adddfe68e743205afe2f7f22a354f4acbd9"} Jun 06 13:58:35.826062 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:35.825792 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 13:58:35.842049 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:35.841984 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" podStartSLOduration=1.472612938 podStartE2EDuration="3.841967577s" totalImagesPullingTime="2.369354639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:58:35.840234426 +0000 UTC m=+612.168774087" watchObservedRunningTime="2026-06-06 13:58:35.841967577 +0000 UTC m=+612.170507300" Jun 06 13:58:46.831940 ip-10-0-139-222 kubenswrapper[2578]: I0606 13:58:46.831862 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-sp25n" Jun 06 14:00:41.012042 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.011944 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-pdvrc"] Jun 06 14:00:41.015883 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.015862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" Jun 06 14:00:41.018480 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.018461 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 14:00:41.018603 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.018555 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nf558\"" Jun 06 14:00:41.026315 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.026289 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-pdvrc"] Jun 06 14:00:41.130452 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.130420 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:00:41.150654 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.150620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tnc\" (UniqueName: \"kubernetes.io/projected/c03830e8-c65a-4a5d-be1d-30b87b28d04e-kube-api-access-t2tnc\") pod \"payload-processing-7c6c859784-pdvrc\" (UID: \"c03830e8-c65a-4a5d-be1d-30b87b28d04e\") " pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" Jun 06 14:00:41.252419 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.252373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tnc\" (UniqueName: \"kubernetes.io/projected/c03830e8-c65a-4a5d-be1d-30b87b28d04e-kube-api-access-t2tnc\") pod \"payload-processing-7c6c859784-pdvrc\" (UID: \"c03830e8-c65a-4a5d-be1d-30b87b28d04e\") " pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" Jun 06 14:00:41.259704 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.259671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tnc\" (UniqueName: \"kubernetes.io/projected/c03830e8-c65a-4a5d-be1d-30b87b28d04e-kube-api-access-t2tnc\") pod \"payload-processing-7c6c859784-pdvrc\" (UID: \"c03830e8-c65a-4a5d-be1d-30b87b28d04e\") " pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" Jun 06 14:00:41.328324 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.328227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" Jun 06 14:00:41.467057 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.467010 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-pdvrc"] Jun 06 14:00:41.470324 ip-10-0-139-222 kubenswrapper[2578]: W0606 14:00:41.470298 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03830e8_c65a_4a5d_be1d_30b87b28d04e.slice/crio-a193c4c90ac0489075b55771bb43b2619d6ff21c4b2deb2894421bb101e6e98f WatchSource:0}: Error finding container a193c4c90ac0489075b55771bb43b2619d6ff21c4b2deb2894421bb101e6e98f: Status 404 returned error can't find the container with id a193c4c90ac0489075b55771bb43b2619d6ff21c4b2deb2894421bb101e6e98f Jun 06 14:00:41.472297 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:41.472281 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 14:00:42.463010 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:42.462969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" event={"ID":"c03830e8-c65a-4a5d-be1d-30b87b28d04e","Type":"ContainerStarted","Data":"a193c4c90ac0489075b55771bb43b2619d6ff21c4b2deb2894421bb101e6e98f"} Jun 06 14:00:44.475695 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:44.475598 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" event={"ID":"c03830e8-c65a-4a5d-be1d-30b87b28d04e","Type":"ContainerStarted","Data":"86f6ccf4f86af1274ff05423cf92ccf536ccc8aa81474f78fcdc0238b6db4f97"} Jun 06 14:00:44.475695 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:44.475667 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" Jun 06 14:00:44.492688 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:44.492640 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" podStartSLOduration=1.821829138 podStartE2EDuration="4.492621762s" totalImagesPullingTime="2.670792624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 14:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 14:00:44.492308821 +0000 UTC m=+740.820848504" watchObservedRunningTime="2026-06-06 14:00:44.492621762 +0000 UTC m=+740.821161431" Jun 06 14:00:48.734375 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:48.734333 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-77k4f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 06 14:00:48.734814 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:48.734402 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" podUID="1dffafbc-01fb-4682-846b-8bba7ea19611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 06 14:00:49.504850 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:49.504816 2578 generic.go:356] "Generic (PLEG): container finished" podID="1dffafbc-01fb-4682-846b-8bba7ea19611" containerID="fe42fd9ff8a139c7d6481177c095082522968023798c9b6966dcec8abdcfbf06" exitCode=0 Jun 06 14:00:49.505051 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:49.504866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" event={"ID":"1dffafbc-01fb-4682-846b-8bba7ea19611","Type":"ContainerDied","Data":"fe42fd9ff8a139c7d6481177c095082522968023798c9b6966dcec8abdcfbf06"} Jun 06 14:00:49.505271 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:49.505255 2578 scope.go:117] "RemoveContainer" containerID="fe42fd9ff8a139c7d6481177c095082522968023798c9b6966dcec8abdcfbf06" Jun 06 14:00:49.506347 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:49.506312 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 14:00:49.506425 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:49.506405 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 14:00:49.506461 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:49.506449 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 06 14:00:50.512436 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:50.512404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" event={"ID":"1dffafbc-01fb-4682-846b-8bba7ea19611","Type":"ContainerStarted","Data":"70e67ab4ed3b0566132153d4be3c8b907b89a1463d20be1ac7d1a39c0e33dc34"} Jun 06 14:00:50.649890 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:50.649844 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 14:00:50.650131 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:50.649979 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-77k4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 06 14:00:50.650131 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:50.650060 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" podUID="1dffafbc-01fb-4682-846b-8bba7ea19611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 06 14:00:51.650137 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:51.650100 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-77k4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 06 14:00:51.650762 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:51.650726 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" podUID="1dffafbc-01fb-4682-846b-8bba7ea19611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 06 14:00:52.650108 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:52.650063 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-77k4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 06 14:00:52.650340 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:52.650157 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" podUID="1dffafbc-01fb-4682-846b-8bba7ea19611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 06 14:00:53.649693 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:53.649640 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-77k4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 06 14:00:53.649920 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:53.649745 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" podUID="1dffafbc-01fb-4682-846b-8bba7ea19611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 06 14:00:54.653538 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:54.653509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 14:00:54.653988 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:54.653786 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 14:00:54.654605 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:54.654586 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-77k4f" Jun 06 14:00:55.483911 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:00:55.483881 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-pdvrc" Jun 06 14:01:51.312249 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:51.312163 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:01:54.912087 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:54.912053 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr"] Jun 06 14:01:54.916964 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:54.916938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:54.919650 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:54.919626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 14:01:54.919650 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:54.919640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 14:01:54.920880 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:54.920856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 06 14:01:54.920998 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:54.920867 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4p9f4\"" Jun 06 14:01:54.926413 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:54.926390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr"] Jun 06 14:01:55.095016 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.094981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17e5fa7e-fa8f-4546-85f3-d371d642b835-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.095268 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.095055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.095268 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.095121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbn9h\" (UniqueName: \"kubernetes.io/projected/17e5fa7e-fa8f-4546-85f3-d371d642b835-kube-api-access-cbn9h\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.095268 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.095145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.095268 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.095170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.095268 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.095201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196458 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbn9h\" (UniqueName: \"kubernetes.io/projected/17e5fa7e-fa8f-4546-85f3-d371d642b835-kube-api-access-cbn9h\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196458 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196458 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196744 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196744 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17e5fa7e-fa8f-4546-85f3-d371d642b835-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196744 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196893 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196841 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.196893 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.197000 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.196968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.198845 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.198825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17e5fa7e-fa8f-4546-85f3-d371d642b835-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.199038 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.199008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17e5fa7e-fa8f-4546-85f3-d371d642b835-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.203821 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.203798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbn9h\" (UniqueName: \"kubernetes.io/projected/17e5fa7e-fa8f-4546-85f3-d371d642b835-kube-api-access-cbn9h\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wwswr\" (UID: \"17e5fa7e-fa8f-4546-85f3-d371d642b835\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.229752 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.229723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:01:55.369188 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.369161 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr"] Jun 06 14:01:55.370766 ip-10-0-139-222 kubenswrapper[2578]: W0606 14:01:55.370738 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e5fa7e_fa8f_4546_85f3_d371d642b835.slice/crio-8ef50b2492617c9f46091407c380dc2317113e573d7bc910b046596dfe3a157e WatchSource:0}: Error finding container 8ef50b2492617c9f46091407c380dc2317113e573d7bc910b046596dfe3a157e: Status 404 returned error can't find the container with id 8ef50b2492617c9f46091407c380dc2317113e573d7bc910b046596dfe3a157e Jun 06 14:01:55.526080 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.525972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:01:55.855554 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:55.855464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" event={"ID":"17e5fa7e-fa8f-4546-85f3-d371d642b835","Type":"ContainerStarted","Data":"8ef50b2492617c9f46091407c380dc2317113e573d7bc910b046596dfe3a157e"} Jun 06 14:01:58.878195 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:01:58.878147 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" event={"ID":"17e5fa7e-fa8f-4546-85f3-d371d642b835","Type":"ContainerStarted","Data":"9df1ff508f3c1903f8570b62ea6072023dab63ba6f89e6a1a3070d8e3b9cbbc7"} Jun 06 14:02:02.900352 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:02.900311 2578 generic.go:356] "Generic (PLEG): container finished" podID="17e5fa7e-fa8f-4546-85f3-d371d642b835" containerID="9df1ff508f3c1903f8570b62ea6072023dab63ba6f89e6a1a3070d8e3b9cbbc7" exitCode=0 Jun 06 14:02:02.900352 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:02.900356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" event={"ID":"17e5fa7e-fa8f-4546-85f3-d371d642b835","Type":"ContainerDied","Data":"9df1ff508f3c1903f8570b62ea6072023dab63ba6f89e6a1a3070d8e3b9cbbc7"} Jun 06 14:02:04.911662 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:04.911628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" event={"ID":"17e5fa7e-fa8f-4546-85f3-d371d642b835","Type":"ContainerStarted","Data":"065326c8932650d880e32c638654af7a1dfd8bf605c1a01047134e1e46c17f94"} Jun 06 14:02:04.931084 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:04.931003 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" podStartSLOduration=2.837792356 podStartE2EDuration="10.930986744s" totalImagesPullingTime="4.403410926s" totalInitContainerRuntime="3.689783462s" isStatefulPod=false podCreationTimestamp="2026-06-06 14:01:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 14:02:04.929455186 +0000 UTC m=+821.257994854" watchObservedRunningTime="2026-06-06 14:02:04.930986744 +0000 UTC m=+821.259526411" Jun 06 14:02:05.230101 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:05.229969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:02:05.230101 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:05.230075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:02:05.242538 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:05.242506 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:02:05.927485 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:05.927456 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wwswr" Jun 06 14:02:10.182143 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:10.182101 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:02:26.392392 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:26.392359 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:02:43.709345 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.709309 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm"] Jun 06 14:02:43.712169 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.712130 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.714682 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.714661 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 06 14:02:43.723720 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.723698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm"] Jun 06 14:02:43.780197 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.780145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m8m8\" (UniqueName: \"kubernetes.io/projected/1256e12a-9b04-40f3-bf36-0598bddde2c7-kube-api-access-4m8m8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.780405 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.780219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1256e12a-9b04-40f3-bf36-0598bddde2c7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.780405 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.780281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.780405 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.780327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.780405 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.780371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.780405 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.780396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.881423 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.881385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m8m8\" (UniqueName: \"kubernetes.io/projected/1256e12a-9b04-40f3-bf36-0598bddde2c7-kube-api-access-4m8m8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.881605 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.881461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1256e12a-9b04-40f3-bf36-0598bddde2c7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.881605 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.881526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.881605 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.881574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.881770 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.881632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.881770 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.881662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.882226 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.882129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.882226 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.882174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.882226 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.882185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.883992 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.883961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1256e12a-9b04-40f3-bf36-0598bddde2c7-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.884565 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.884545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1256e12a-9b04-40f3-bf36-0598bddde2c7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:43.890105 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:43.890012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m8m8\" (UniqueName: \"kubernetes.io/projected/1256e12a-9b04-40f3-bf36-0598bddde2c7-kube-api-access-4m8m8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm\" (UID: \"1256e12a-9b04-40f3-bf36-0598bddde2c7\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:44.024685 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:44.024589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:44.162626 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:44.162596 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm"] Jun 06 14:02:44.164460 ip-10-0-139-222 kubenswrapper[2578]: W0606 14:02:44.164434 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1256e12a_9b04_40f3_bf36_0598bddde2c7.slice/crio-7fceeeb3f2582964171c3cee8a084e0e7ca5841d511ed0572f6c17a8b22ee055 WatchSource:0}: Error finding container 7fceeeb3f2582964171c3cee8a084e0e7ca5841d511ed0572f6c17a8b22ee055: Status 404 returned error can't find the container with id 7fceeeb3f2582964171c3cee8a084e0e7ca5841d511ed0572f6c17a8b22ee055 Jun 06 14:02:44.536883 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:44.536840 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:02:45.126555 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:45.126524 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" event={"ID":"1256e12a-9b04-40f3-bf36-0598bddde2c7","Type":"ContainerStarted","Data":"75140d4fe18ac81add0ca12021b042b0f0dcb4514e458c6589818b0ec37732cd"} Jun 06 14:02:45.126949 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:45.126573 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" event={"ID":"1256e12a-9b04-40f3-bf36-0598bddde2c7","Type":"ContainerStarted","Data":"7fceeeb3f2582964171c3cee8a084e0e7ca5841d511ed0572f6c17a8b22ee055"} Jun 06 14:02:46.133513 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:46.133477 2578 generic.go:356] "Generic (PLEG): container finished" podID="1256e12a-9b04-40f3-bf36-0598bddde2c7" containerID="75140d4fe18ac81add0ca12021b042b0f0dcb4514e458c6589818b0ec37732cd" exitCode=0 Jun 06 14:02:46.138208 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:46.138181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" event={"ID":"1256e12a-9b04-40f3-bf36-0598bddde2c7","Type":"ContainerDied","Data":"75140d4fe18ac81add0ca12021b042b0f0dcb4514e458c6589818b0ec37732cd"} Jun 06 14:02:47.141283 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:47.141249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" event={"ID":"1256e12a-9b04-40f3-bf36-0598bddde2c7","Type":"ContainerStarted","Data":"bba1383e323f650f971a4d66e09c107f8293def9d3b1aed4e27e21f3ce92e350"} Jun 06 14:02:47.159054 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:47.158990 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" podStartSLOduration=2.619587927 podStartE2EDuration="4.15897335s" totalImagesPullingTime="227.00861ms" totalInitContainerRuntime="1.312376813s" isStatefulPod=false podCreationTimestamp="2026-06-06 14:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 14:02:47.157910374 +0000 UTC m=+863.486450066" watchObservedRunningTime="2026-06-06 14:02:47.15897335 +0000 UTC m=+863.487513016" Jun 06 14:02:54.025142 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:54.025100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:54.025665 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:54.025177 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:54.041307 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:54.041275 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:02:54.188515 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:02:54.188485 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm" Jun 06 14:03:03.384522 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:03:03.384487 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:04:53.086041 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:04:53.085921 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:05:03.483338 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:05:03.483299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:05:12.483598 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:05:12.483554 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:05:22.888158 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:05:22.888119 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:05:31.595113 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:05:31.595074 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:05:41.482062 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:05:41.482002 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:06:16.882787 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:06:16.882697 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:06:19.982566 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:06:19.982530 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:06:56.389382 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:06:56.389349 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:07:12.981144 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:07:12.981100 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:07:50.682963 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:07:50.682876 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:08:07.785793 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:07.785757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:08:21.689901 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:21.689865 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:08:37.790095 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:37.790063 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:08:40.494775 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:40.494745 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-sp25n"] Jun 06 14:08:55.910419 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:55.910394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6478c66b55-bk64g_b32b1db9-75cf-4767-ace5-c1d925250aff/nginx/0.log" Jun 06 14:08:56.850203 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:56.850174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw_edae3eb6-ce24-409f-80e9-2578d4f9c654/copy-manifests/0.log" Jun 06 14:08:56.856315 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:56.856294 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw_edae3eb6-ce24-409f-80e9-2578d4f9c654/manager/0.log" Jun 06 14:08:58.331201 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:58.331170 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-22vlw_66e01c02-5a3c-41b9-b513-308e8d9ca58f/manager/0.log" Jun 06 14:08:58.441760 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:58.441727 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nhfs2_8feb7b32-8d5b-4d24-ac99-038f5b495be8/manager/0.log" Jun 06 14:08:58.677764 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:58.677738 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n4cw6_f74b295a-b2ad-47f5-ba11-aa1822b921ca/registry-server/0.log" Jun 06 14:08:58.794696 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:58.794661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wpwkk_ae2a146e-7f9c-4da1-8793-7fc5787ba0e0/manager/0.log" Jun 06 14:08:58.904676 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:58.904652 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sp25n_149c5aed-046d-4dd7-845e-2dc6c12452fb/limitador/0.log" Jun 06 14:08:59.373833 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:59.373801 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795p9ghw_848491b0-b204-4342-acd5-b23db745f7f2/istio-proxy/0.log" Jun 06 14:08:59.825126 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:08:59.825042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/1.log" Jun 06 14:09:00.045403 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:00.045374 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-pdvrc_c03830e8-c65a-4a5d-be1d-30b87b28d04e/payload-processing/0.log" Jun 06 14:09:00.154424 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:00.154394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d9fc48c-xpkpp_71bc42da-b610-4f10-97ab-d21003702a8d/router/0.log" Jun 06 14:09:00.609654 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:00.609621 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-wwswr_17e5fa7e-fa8f-4546-85f3-d371d642b835/storage-initializer/0.log" Jun 06 14:09:00.616186 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:00.616156 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-wwswr_17e5fa7e-fa8f-4546-85f3-d371d642b835/main/0.log" Jun 06 14:09:00.948510 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:00.948430 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm_1256e12a-9b04-40f3-bf36-0598bddde2c7/storage-initializer/0.log" Jun 06 14:09:00.955629 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:00.955597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-vzvgm_1256e12a-9b04-40f3-bf36-0598bddde2c7/main/0.log" Jun 06 14:09:08.187812 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:08.187784 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h9f4q_e1007746-5164-438c-ad0e-eb5d1ab2d351/global-pull-secret-syncer/0.log" Jun 06 14:09:08.357077 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:08.357045 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v65zt_bb03a033-6909-4c2b-a70c-0e634874820f/konnectivity-agent/0.log" Jun 06 14:09:08.420132 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:08.420107 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-222.ec2.internal_b2f79e97766e8282ec015d0786dde0e4/haproxy/0.log" Jun 06 14:09:13.415933 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:13.415802 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-22vlw_66e01c02-5a3c-41b9-b513-308e8d9ca58f/manager/0.log" Jun 06 14:09:13.455157 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:13.455125 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nhfs2_8feb7b32-8d5b-4d24-ac99-038f5b495be8/manager/0.log" Jun 06 14:09:13.508137 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:13.508104 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n4cw6_f74b295a-b2ad-47f5-ba11-aa1822b921ca/registry-server/0.log" Jun 06 14:09:13.549905 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:13.549851 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wpwkk_ae2a146e-7f9c-4da1-8793-7fc5787ba0e0/manager/0.log" Jun 06 14:09:13.570595 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:13.570567 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-sp25n_149c5aed-046d-4dd7-845e-2dc6c12452fb/limitador/0.log" Jun 06 14:09:15.108357 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.108333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e6a78371-7347-4cef-b174-b23de2bac325/alertmanager/0.log" Jun 06 14:09:15.127872 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.127847 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e6a78371-7347-4cef-b174-b23de2bac325/config-reloader/0.log" Jun 06 14:09:15.149090 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.149062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e6a78371-7347-4cef-b174-b23de2bac325/kube-rbac-proxy-web/0.log" Jun 06 14:09:15.171350 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.171324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e6a78371-7347-4cef-b174-b23de2bac325/kube-rbac-proxy/0.log" Jun 06 14:09:15.195624 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.195601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e6a78371-7347-4cef-b174-b23de2bac325/kube-rbac-proxy-metric/0.log" Jun 06 14:09:15.215734 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.215704 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e6a78371-7347-4cef-b174-b23de2bac325/prom-label-proxy/0.log" Jun 06 14:09:15.238966 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.238939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e6a78371-7347-4cef-b174-b23de2bac325/init-config-reloader/0.log" Jun 06 14:09:15.306811 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.306779 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mchz4_ee00d4cb-4514-454a-b1eb-e21b6a181d04/kube-state-metrics/0.log" Jun 06 14:09:15.334693 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.334650 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mchz4_ee00d4cb-4514-454a-b1eb-e21b6a181d04/kube-rbac-proxy-main/0.log" Jun 06 14:09:15.351989 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.351954 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-mchz4_ee00d4cb-4514-454a-b1eb-e21b6a181d04/kube-rbac-proxy-self/0.log" Jun 06 14:09:15.433263 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.433173 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zccv_898fe78c-3563-4723-8123-b3c56d421bbd/node-exporter/0.log" Jun 06 14:09:15.454610 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.454587 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zccv_898fe78c-3563-4723-8123-b3c56d421bbd/kube-rbac-proxy/0.log" Jun 06 14:09:15.475348 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.475322 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2zccv_898fe78c-3563-4723-8123-b3c56d421bbd/init-textfile/0.log" Jun 06 14:09:15.773978 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.773955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fb94000c-4d10-46db-bf84-00e2416b12bf/prometheus/0.log" Jun 06 14:09:15.799236 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.799211 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fb94000c-4d10-46db-bf84-00e2416b12bf/config-reloader/0.log" Jun 06 14:09:15.823253 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.823231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fb94000c-4d10-46db-bf84-00e2416b12bf/thanos-sidecar/0.log" Jun 06 14:09:15.843314 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.843287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fb94000c-4d10-46db-bf84-00e2416b12bf/kube-rbac-proxy-web/0.log" Jun 06 14:09:15.863294 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.863266 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fb94000c-4d10-46db-bf84-00e2416b12bf/kube-rbac-proxy/0.log" Jun 06 14:09:15.889547 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.889519 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fb94000c-4d10-46db-bf84-00e2416b12bf/kube-rbac-proxy-thanos/0.log" Jun 06 14:09:15.910592 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.910564 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fb94000c-4d10-46db-bf84-00e2416b12bf/init-config-reloader/0.log" Jun 06 14:09:15.939392 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.939305 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9jzfq_e6988888-0f46-4e15-8aa1-2ed15ce6d569/prometheus-operator/0.log" Jun 06 14:09:15.958509 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.958484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9jzfq_e6988888-0f46-4e15-8aa1-2ed15ce6d569/kube-rbac-proxy/0.log" Jun 06 14:09:15.987072 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:15.987042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-ddwkn_51c9e6e2-b6d5-4b0a-a3d9-423de48a39f8/prometheus-operator-admission-webhook/0.log" Jun 06 14:09:16.019630 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.019586 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87f54c966-x8wqr_0aa09519-8f8f-47d3-91dd-fc4846275774/telemeter-client/0.log" Jun 06 14:09:16.039598 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.039570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87f54c966-x8wqr_0aa09519-8f8f-47d3-91dd-fc4846275774/reload/0.log" Jun 06 14:09:16.064347 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.064321 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-87f54c966-x8wqr_0aa09519-8f8f-47d3-91dd-fc4846275774/kube-rbac-proxy/0.log" Jun 06 14:09:16.112817 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.112785 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/thanos-query/0.log" Jun 06 14:09:16.132636 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.132610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy-web/0.log" Jun 06 14:09:16.151736 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.151711 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy/0.log" Jun 06 14:09:16.171529 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.171500 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/prom-label-proxy/0.log" Jun 06 14:09:16.191187 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.191066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy-rules/0.log" Jun 06 14:09:16.210542 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:16.210510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7fb58df84c-qvfg8_9b3950f5-8bb5-43bd-9449-2b352730d7d2/kube-rbac-proxy-metrics/0.log" Jun 06 14:09:18.761119 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:18.761093 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-r4w6z_65a6f0ec-b650-426b-9d29-3b6fbb864e62/download-server/0.log" Jun 06 14:09:19.105012 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.104927 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq"] Jun 06 14:09:19.108576 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.108554 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.111163 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.111139 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqffg\"/\"kube-root-ca.crt\"" Jun 06 14:09:19.111267 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.111225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wqffg\"/\"default-dockercfg-8vvjh\"" Jun 06 14:09:19.112499 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.112476 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqffg\"/\"openshift-service-ca.crt\"" Jun 06 14:09:19.119204 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.119172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq"] Jun 06 14:09:19.210310 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.210280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-lib-modules\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.210506 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.210316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-proc\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.210506 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.210437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-sys\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.210506 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.210479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtpgg\" (UniqueName: \"kubernetes.io/projected/27ee8339-9854-4748-a940-0ff5a4d35efb-kube-api-access-qtpgg\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.210655 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.210561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-podres\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312006 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.311973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-proc\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312198 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-sys\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312198 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtpgg\" (UniqueName: \"kubernetes.io/projected/27ee8339-9854-4748-a940-0ff5a4d35efb-kube-api-access-qtpgg\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312198 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-proc\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312198 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-podres\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312198 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-sys\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312390 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-lib-modules\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312390 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-podres\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.312390 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.312362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27ee8339-9854-4748-a940-0ff5a4d35efb-lib-modules\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.319364 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.319337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtpgg\" (UniqueName: \"kubernetes.io/projected/27ee8339-9854-4748-a940-0ff5a4d35efb-kube-api-access-qtpgg\") pod \"perf-node-gather-daemonset-b5zbq\" (UID: \"27ee8339-9854-4748-a940-0ff5a4d35efb\") " pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.419807 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.419775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:19.545878 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.545851 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-ws4cf_5e03bab1-6a6d-4636-8c40-33e202bdf487/volume-data-source-validator/0.log" Jun 06 14:09:19.551394 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:19.551374 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq"] Jun 06 14:09:19.553590 ip-10-0-139-222 kubenswrapper[2578]: W0606 14:09:19.553566 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27ee8339_9854_4748_a940_0ff5a4d35efb.slice/crio-0173dd0b1d3789405c8cc23ff00c921e1ef8f20e22f22879892c8e136941defb WatchSource:0}: Error finding container 0173dd0b1d3789405c8cc23ff00c921e1ef8f20e22f22879892c8e136941defb: Status 404 returned error can't find the container with id 0173dd0b1d3789405c8cc23ff00c921e1ef8f20e22f22879892c8e136941defb Jun 06 14:09:20.220271 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:20.220240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" event={"ID":"27ee8339-9854-4748-a940-0ff5a4d35efb","Type":"ContainerStarted","Data":"e84fcc85a04788ec897901c78712863ece55c10a8a71fe1f7bb90f58391619af"} Jun 06 14:09:20.220647 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:20.220290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" event={"ID":"27ee8339-9854-4748-a940-0ff5a4d35efb","Type":"ContainerStarted","Data":"0173dd0b1d3789405c8cc23ff00c921e1ef8f20e22f22879892c8e136941defb"} Jun 06 14:09:20.220647 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:20.220364 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:20.235975 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:20.235935 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" podStartSLOduration=1.235922587 podStartE2EDuration="1.235922587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 14:09:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 14:09:20.235192127 +0000 UTC m=+1256.563731833" watchObservedRunningTime="2026-06-06 14:09:20.235922587 +0000 UTC m=+1256.564462304" Jun 06 14:09:20.757493 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:20.757462 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9jfsf_23c2a91d-1644-406e-b1b1-8bd9545d4f7b/dns/0.log" Jun 06 14:09:20.776148 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:20.776124 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9jfsf_23c2a91d-1644-406e-b1b1-8bd9545d4f7b/kube-rbac-proxy/0.log" Jun 06 14:09:20.862163 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:20.862141 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vvtkr_b214ff39-d422-4f07-9180-798938c62cbd/dns-node-resolver/0.log" Jun 06 14:09:21.458208 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:21.458180 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rswsp_8e54b170-c19f-43b1-b4ee-dc50595328ee/node-ca/0.log" Jun 06 14:09:22.379379 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:22.379350 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795p9ghw_848491b0-b204-4342-acd5-b23db745f7f2/istio-proxy/0.log" Jun 06 14:09:22.556960 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:22.556927 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/0.log" Jun 06 14:09:22.564232 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:22.564209 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/1.log" Jun 06 14:09:22.632677 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:22.632590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-pdvrc_c03830e8-c65a-4a5d-be1d-30b87b28d04e/payload-processing/0.log" Jun 06 14:09:22.660953 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:22.660932 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d9fc48c-xpkpp_71bc42da-b610-4f10-97ab-d21003702a8d/router/0.log" Jun 06 14:09:23.273481 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:23.273455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hd6gw_9bfa30a8-3e12-4903-a2c5-953bea0cecdc/serve-healthcheck-canary/0.log" Jun 06 14:09:23.753818 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:23.753784 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-gv8ss_9d9cbaff-2630-46d9-b6da-971c9ed8430a/insights-operator/0.log" Jun 06 14:09:23.755293 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:23.755273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-gv8ss_9d9cbaff-2630-46d9-b6da-971c9ed8430a/insights-operator/1.log" Jun 06 14:09:23.776368 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:23.776345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5k5bf_ec86dc7d-03a0-4a01-9c7f-266cbb2e4478/kube-rbac-proxy/0.log" Jun 06 14:09:23.796583 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:23.796559 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5k5bf_ec86dc7d-03a0-4a01-9c7f-266cbb2e4478/exporter/0.log" Jun 06 14:09:23.816466 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:23.816447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5k5bf_ec86dc7d-03a0-4a01-9c7f-266cbb2e4478/extractor/0.log" Jun 06 14:09:26.101303 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:26.101275 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6478c66b55-bk64g_b32b1db9-75cf-4767-ace5-c1d925250aff/nginx/0.log" Jun 06 14:09:26.236176 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:26.236150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wqffg/perf-node-gather-daemonset-b5zbq" Jun 06 14:09:26.379252 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:26.379224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw_edae3eb6-ce24-409f-80e9-2578d4f9c654/manager/0.log" Jun 06 14:09:26.397740 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:26.397712 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f6fd7bb-dx8sw_edae3eb6-ce24-409f-80e9-2578d4f9c654/copy-manifests/0.log" Jun 06 14:09:28.038502 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:28.038474 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67798f9b5c-qczlh_ae8bcc46-d059-42e2-8678-3d2996820124/manager/0.log" Jun 06 14:09:33.358037 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:33.357998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795p9ghw_848491b0-b204-4342-acd5-b23db745f7f2/istio-proxy/0.log" Jun 06 14:09:33.488623 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:33.484744 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/0.log" Jun 06 14:09:33.496276 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:33.496249 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/1.log" Jun 06 14:09:33.540548 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:33.540521 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-pdvrc_c03830e8-c65a-4a5d-be1d-30b87b28d04e/payload-processing/0.log" Jun 06 14:09:33.553989 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:33.553965 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d9fc48c-xpkpp_71bc42da-b610-4f10-97ab-d21003702a8d/router/0.log" Jun 06 14:09:34.669430 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.669401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795p9ghw_848491b0-b204-4342-acd5-b23db745f7f2/istio-proxy/0.log" Jun 06 14:09:34.776230 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.776189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/0.log" Jun 06 14:09:34.783408 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.783377 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/1.log" Jun 06 14:09:34.826986 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.826957 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-pdvrc_c03830e8-c65a-4a5d-be1d-30b87b28d04e/payload-processing/0.log" Jun 06 14:09:34.845367 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.845343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d9fc48c-xpkpp_71bc42da-b610-4f10-97ab-d21003702a8d/router/0.log" Jun 06 14:09:34.915299 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.915276 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmmsg_7fc70265-2e52-4cf0-a705-8a26a3d1ebe3/kube-multus-additional-cni-plugins/0.log" Jun 06 14:09:34.935621 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.935549 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmmsg_7fc70265-2e52-4cf0-a705-8a26a3d1ebe3/egress-router-binary-copy/0.log" Jun 06 14:09:34.954742 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.954711 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmmsg_7fc70265-2e52-4cf0-a705-8a26a3d1ebe3/cni-plugins/0.log" Jun 06 14:09:34.974330 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.974304 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmmsg_7fc70265-2e52-4cf0-a705-8a26a3d1ebe3/bond-cni-plugin/0.log" Jun 06 14:09:34.992704 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:34.992684 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmmsg_7fc70265-2e52-4cf0-a705-8a26a3d1ebe3/routeoverride-cni/0.log" Jun 06 14:09:35.011772 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:35.011750 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmmsg_7fc70265-2e52-4cf0-a705-8a26a3d1ebe3/whereabouts-cni-bincopy/0.log" Jun 06 14:09:35.031533 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:35.031501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nmmsg_7fc70265-2e52-4cf0-a705-8a26a3d1ebe3/whereabouts-cni/0.log" Jun 06 14:09:35.208007 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:35.207922 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ghjj2_ee22ebaa-1d9a-4a7e-bb6a-da8eecdbc5ea/kube-multus/0.log" Jun 06 14:09:35.384356 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:35.384328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sbklr_9299878a-be24-4725-a280-d9714a5b4ab4/network-metrics-daemon/0.log" Jun 06 14:09:35.402674 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:35.402637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sbklr_9299878a-be24-4725-a280-d9714a5b4ab4/kube-rbac-proxy/0.log" Jun 06 14:09:36.384146 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.384120 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795p9ghw_848491b0-b204-4342-acd5-b23db745f7f2/istio-proxy/0.log" Jun 06 14:09:36.503406 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.503375 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wdgxr_506fa8b1-e0db-4ee7-8b14-650330c41a4e/ovn-controller/0.log" Jun 06 14:09:36.505318 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.505295 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/0.log" Jun 06 14:09:36.512733 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.512716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-77k4f_1dffafbc-01fb-4682-846b-8bba7ea19611/istio-proxy/1.log" Jun 06 14:09:36.521494 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.521477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wdgxr_506fa8b1-e0db-4ee7-8b14-650330c41a4e/ovn-acl-logging/0.log" Jun 06 14:09:36.548044 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.548002 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wdgxr_506fa8b1-e0db-4ee7-8b14-650330c41a4e/kube-rbac-proxy-node/0.log" Jun 06 14:09:36.561900 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.561876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-pdvrc_c03830e8-c65a-4a5d-be1d-30b87b28d04e/payload-processing/0.log" Jun 06 14:09:36.568370 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.568349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wdgxr_506fa8b1-e0db-4ee7-8b14-650330c41a4e/kube-rbac-proxy-ovn-metrics/0.log" Jun 06 14:09:36.579521 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.579500 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9d9fc48c-xpkpp_71bc42da-b610-4f10-97ab-d21003702a8d/router/0.log" Jun 06 14:09:36.585692 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.585671 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wdgxr_506fa8b1-e0db-4ee7-8b14-650330c41a4e/northd/0.log" Jun 06 14:09:36.607405 ip-10-0-139-222 kubenswrapper[2578]: I0606 14:09:36.607380 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wdgxr_506fa8b1-e0db-4ee7-8b14-650330c41a4e/nbdb/0.log"