Jun 11 15:02:26.062041 ip-10-0-136-38 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 15:02:26.062053 ip-10-0-136-38 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 15:02:26.062063 ip-10-0-136-38 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 15:02:26.062277 ip-10-0-136-38 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 15:02:36.088795 ip-10-0-136-38 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 15:02:36.088812 ip-10-0-136-38 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0fbfbde6f22e44639fa83061bbaa3af0 -- Jun 11 15:05:22.766107 ip-10-0-136-38 systemd[1]: Starting Kubernetes Kubelet... Jun 11 15:05:23.157260 ip-10-0-136-38 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:05:23.157260 ip-10-0-136-38 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 15:05:23.157260 ip-10-0-136-38 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:05:23.157260 ip-10-0-136-38 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 15:05:23.157260 ip-10-0-136-38 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:05:23.158266 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.158178 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 15:05:23.161966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161951 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:05:23.161966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161967 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161973 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161977 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161981 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161984 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161988 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161992 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161995 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.161998 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162000 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162003 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162005 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162008 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162010 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162013 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162015 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162018 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162021 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162023 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:05:23.162031 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162025 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162029 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162038 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162041 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162045 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162048 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162052 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162054 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162057 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162060 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162062 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162065 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162067 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162070 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162072 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162075 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162077 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162080 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162082 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:05:23.162480 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162085 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162087 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162090 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162093 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162095 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162097 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162100 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162102 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162105 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162108 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162110 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162113 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162115 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162118 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162120 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162123 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162126 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162129 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162132 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162134 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:05:23.162960 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162137 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162139 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162141 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162144 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162146 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162149 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162151 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162154 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162156 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162158 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162161 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162163 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162166 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162168 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162171 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162173 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162175 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162178 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162180 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162183 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:05:23.163468 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162186 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162190 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162193 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162195 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162197 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162200 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162202 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162206 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162209 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162211 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162214 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162216 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162219 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162222 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162224 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162227 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162230 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162232 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162235 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.162237 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:05:23.163966 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163173 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163181 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163184 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163188 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163191 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163193 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163197 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163199 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163202 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163204 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163207 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163210 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163213 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163215 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163219 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163221 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163224 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163227 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163229 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:05:23.164448 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163232 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163235 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163238 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163240 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163242 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163245 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163247 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163250 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163252 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163255 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163258 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163260 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163263 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163265 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163268 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163270 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163273 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163275 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163278 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163280 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:05:23.164943 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163283 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163285 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163288 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163290 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163293 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163295 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163298 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163300 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163304 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163306 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163308 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163311 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163316 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163319 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163321 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163324 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163326 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163331 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163334 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:05:23.165420 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163337 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163340 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163343 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163345 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163348 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163350 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163353 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163355 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163358 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163360 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163364 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163367 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163370 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163372 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163375 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163377 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163380 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163383 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163385 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163388 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:05:23.165898 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163390 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163393 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163395 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163398 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163401 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163405 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163408 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163412 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163415 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163418 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163421 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163424 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163427 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163429 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163432 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163434 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163437 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163439 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163442 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:05:23.166374 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163444 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163447 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163835 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163841 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163843 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163846 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163849 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163852 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163854 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163857 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163859 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163862 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163864 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163867 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163869 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163872 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163875 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163878 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163881 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163883 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163886 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:05:23.166837 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163889 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163892 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163894 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163897 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163899 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163902 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163905 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163907 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163910 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163912 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163915 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163917 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163920 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163922 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163925 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163927 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163930 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163932 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163935 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163937 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:05:23.167358 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163940 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163942 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163944 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163947 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163949 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163952 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163954 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163957 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163960 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163963 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163966 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163968 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163971 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163974 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163977 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163980 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163982 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163985 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163988 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.163990 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:05:23.167855 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164002 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164005 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164008 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164010 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164014 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164016 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164019 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164021 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164024 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164026 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164030 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164034 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164038 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164041 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164045 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164048 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164051 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164054 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164056 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:05:23.168346 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164060 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164064 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164069 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164072 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164075 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164078 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164081 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164083 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164086 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164088 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164091 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164093 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164096 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164098 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164101 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164103 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164105 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164108 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164110 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164113 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:05:23.168795 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164117 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164207 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164218 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164226 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164233 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164240 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164244 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164249 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164253 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164256 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164259 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164262 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164266 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164268 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164280 2576 flags.go:64] FLAG: --cgroup-root="" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164283 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164286 2576 flags.go:64] FLAG: --client-ca-file="" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164289 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164291 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164298 2576 flags.go:64] FLAG: --cluster-domain="" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164301 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164304 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164307 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164310 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 15:05:23.169285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164314 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164316 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164319 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164322 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164325 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164328 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164331 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164334 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164337 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164341 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164344 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164346 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164349 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164352 2576 flags.go:64] FLAG: --enable-server="true" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164354 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164360 2576 flags.go:64] FLAG: --event-burst="100" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164363 2576 flags.go:64] FLAG: --event-qps="50" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164366 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164369 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164372 2576 flags.go:64] FLAG: --eviction-hard="" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164375 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164378 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164382 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164390 2576 flags.go:64] FLAG: --eviction-soft="" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164393 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 15:05:23.169878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164396 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164399 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164401 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164404 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164407 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164410 2576 flags.go:64] FLAG: --feature-gates="" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164413 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164417 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164419 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164422 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164425 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164428 2576 flags.go:64] FLAG: --help="false" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164430 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164433 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164436 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164439 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164442 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164445 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164448 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164450 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164453 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164456 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164459 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164462 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 15:05:23.170509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164465 2576 flags.go:64] FLAG: --kube-reserved="" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164467 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164470 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164473 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164476 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164479 2576 flags.go:64] FLAG: --lock-file="" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164482 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164491 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164494 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164499 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164501 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164504 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164507 2576 flags.go:64] FLAG: --logging-format="text" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164510 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164513 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164516 2576 flags.go:64] FLAG: --manifest-url="" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164518 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164523 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164525 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164534 2576 flags.go:64] FLAG: --max-pods="110" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164536 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164539 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164542 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164545 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164548 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 15:05:23.171153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164550 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164553 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164560 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164563 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164566 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164569 2576 flags.go:64] FLAG: --pod-cidr="" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164571 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164576 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164579 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164582 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164585 2576 flags.go:64] FLAG: --port="10250" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164587 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164590 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1467f4a44b40c5e" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164593 2576 flags.go:64] FLAG: --qos-reserved="" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164596 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164605 2576 flags.go:64] FLAG: --register-node="true" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164608 2576 flags.go:64] FLAG: --register-with-taints="" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164611 2576 flags.go:64] FLAG: --registry-burst="10" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164614 2576 flags.go:64] FLAG: --registry-qps="5" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164617 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164620 2576 flags.go:64] FLAG: --reserved-memory="" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164623 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164627 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164629 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164632 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 15:05:23.171760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164635 2576 flags.go:64] FLAG: --runonce="false" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164637 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164641 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164643 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164646 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164649 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164652 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164655 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164657 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164660 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164663 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164666 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164668 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164671 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164674 2576 flags.go:64] FLAG: --system-cgroups="" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164677 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164682 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164684 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164687 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164694 2576 flags.go:64] FLAG: --tls-min-version="" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164696 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164699 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164702 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164712 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164715 2576 flags.go:64] FLAG: --v="2" Jun 11 15:05:23.172430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164719 2576 flags.go:64] FLAG: --version="false" Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164723 2576 flags.go:64] FLAG: --vmodule="" Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164726 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.164729 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164873 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164878 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164881 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164885 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164888 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164891 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164894 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164896 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164899 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164903 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164907 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164909 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164912 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164915 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164918 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164920 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:05:23.173041 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164923 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164925 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164928 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164930 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164934 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164937 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164940 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164943 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164946 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164949 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164952 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164955 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164958 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164960 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164963 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164965 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164968 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164970 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164973 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164977 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:05:23.173537 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164979 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164982 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164984 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164987 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164989 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164992 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164994 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164996 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.164999 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165002 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165004 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165007 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165009 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165013 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165016 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165019 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165022 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165025 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165029 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:05:23.174034 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165031 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165033 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165036 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165038 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165041 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165047 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165049 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165052 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165054 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165056 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165059 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165061 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165065 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165067 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165070 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165072 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165075 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165078 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165080 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165082 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:05:23.174488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165085 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165087 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165089 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165092 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165094 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165097 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165099 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165102 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165104 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165107 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165109 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165116 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165119 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165122 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165124 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165126 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165129 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165131 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165135 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165137 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:05:23.175115 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165140 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165142 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165145 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.165147 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.165970 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.172844 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.172957 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.172977 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.172983 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173040 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173046 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173050 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173053 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173057 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173060 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:05:23.175596 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173063 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173066 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173069 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173071 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173074 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173077 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173079 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173082 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173085 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173087 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173090 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173092 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173095 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173097 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173100 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173103 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173105 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173108 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173112 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173116 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:05:23.176013 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173119 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173122 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173124 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173128 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173131 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173133 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173136 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173138 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173141 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173143 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173146 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173148 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173151 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173153 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173156 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173158 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173161 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173164 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173166 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:05:23.176494 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173168 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173171 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173173 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173176 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173178 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173181 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173184 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173188 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173191 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173194 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173197 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173200 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173203 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173206 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173208 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173211 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173214 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173217 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173219 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173222 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:05:23.176993 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173224 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173226 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173229 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173231 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173234 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173236 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173239 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173241 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173243 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173246 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173248 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173251 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173253 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173256 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173258 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173261 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173263 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173266 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173269 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:05:23.177488 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173271 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173274 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173276 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173279 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173282 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173286 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173288 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173291 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173294 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173296 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173299 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173302 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173304 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173307 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173309 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:05:23.178020 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.173314 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173447 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173453 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173455 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173458 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173461 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173464 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173467 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173469 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173472 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173476 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173481 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173485 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173487 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173490 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173493 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173495 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173497 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173500 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:05:23.178387 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173502 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173505 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173507 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173510 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173512 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173515 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173517 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173521 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173523 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173526 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173529 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173531 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173534 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173537 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173539 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173542 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173544 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173547 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173550 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173552 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:05:23.178852 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173554 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173557 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173559 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173562 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173564 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173567 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173569 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173571 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173574 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173576 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173579 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173581 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173584 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173586 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173589 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173591 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173593 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173596 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173598 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173601 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:05:23.179404 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173603 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173606 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173608 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173611 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173614 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173616 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173618 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173620 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173623 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173626 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173628 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173630 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173632 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173635 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173637 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173639 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173642 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173644 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173646 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173649 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:05:23.180018 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173651 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173655 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173659 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173661 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173664 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173667 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173669 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173671 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173674 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173676 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173679 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173682 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173684 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173686 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173689 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173691 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173694 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173696 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173699 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:05:23.180512 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173701 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:23.173703 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.173708 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.173834 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.175638 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.176844 2576 server.go:1019] "Starting client certificate rotation" Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.176941 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.176972 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:05:23.180989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.179325 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:05:23.189175 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.189147 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:05:23.197664 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.197645 2576 log.go:25] "Validated CRI v1 runtime API" Jun 11 15:05:23.200310 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.200293 2576 log.go:25] "Validated CRI v1 image API" Jun 11 15:05:23.201123 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.201107 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 15:05:23.202619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.202603 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:05:23.206707 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.206680 2576 fs.go:135] Filesystem UUIDs: map[0b65e956-6bb8-4b89-b327-3107a394062b:/dev/nvme0n1p4 66721f9e-9ece-4851-a530-20ab825ab187:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 11 15:05:23.206778 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.206706 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 15:05:23.212481 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.212369 2576 manager.go:216] Machine: {Timestamp:2026-06-11 15:05:23.211146708 +0000 UTC m=+0.328638620 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099653 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f34f1190c4678a853f2232d14d6fd SystemUUID:ec2f34f1-190c-4678-a853-f2232d14d6fd BootID:0fbfbde6-f22e-4463-9fa8-3061bbaa3af0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:b5:24:aa:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:b5:24:aa:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:fe:2a:4b:a4:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 15:05:23.212481 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.212476 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 15:05:23.212591 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.212561 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 15:05:23.215311 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.215282 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 15:05:23.215480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.215315 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 15:05:23.215980 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.215970 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 15:05:23.216025 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.215983 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 15:05:23.216025 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.215998 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:05:23.216577 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.216566 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:05:23.217247 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.217237 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 15:05:23.220123 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220112 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:05:23.220252 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220243 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 15:05:23.220281 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220273 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 11 15:05:23.220308 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220283 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 15:05:23.220308 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220298 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 15:05:23.220308 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220308 2576 kubelet.go:398] "Adding apiserver pod source" Jun 11 15:05:23.220391 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220317 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 15:05:23.220629 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220619 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:05:23.220661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.220637 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:05:23.226764 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.226743 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xtnml" Jun 11 15:05:23.229335 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.229318 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 15:05:23.230182 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.230143 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 15:05:23.230260 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.230214 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 15:05:23.230678 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.230665 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 15:05:23.230722 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.230696 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 15:05:23.231704 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231692 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 15:05:23.231754 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231711 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 15:05:23.231754 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231717 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 15:05:23.231754 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231723 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 15:05:23.231754 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231731 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 15:05:23.231754 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231736 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 15:05:23.231908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231818 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 15:05:23.231908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231824 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 15:05:23.231908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231830 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 15:05:23.231908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231836 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 15:05:23.231908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231844 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 15:05:23.231908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.231858 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 15:05:23.232626 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.232616 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 15:05:23.232626 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.232626 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 15:05:23.235685 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.235666 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xtnml" Jun 11 15:05:23.237047 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.237033 2576 server.go:1268] "Started kubelet" Jun 11 15:05:23.237994 ip-10-0-136-38 systemd[1]: Started Kubernetes Kubelet. Jun 11 15:05:23.240008 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.239945 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 15:05:23.240143 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.237621 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 15:05:23.240242 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.240175 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 15:05:23.242917 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.242899 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 15:05:23.242997 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.242984 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 11 15:05:23.243649 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.243630 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 15:05:23.245634 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.245615 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 15:05:23.246911 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.246888 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 15:05:23.246911 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.246901 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 15:05:23.247061 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.246961 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.247389 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.247373 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 15:05:23.247389 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.247373 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 15:05:23.247532 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.247395 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 15:05:23.247532 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.247468 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 11 15:05:23.247532 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.247476 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 11 15:05:23.249675 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.249499 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:05:23.249675 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.249638 2576 factory.go:55] Registering systemd factory Jun 11 15:05:23.249675 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.249654 2576 factory.go:223] Registration of the systemd container factory successfully Jun 11 15:05:23.249979 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.249890 2576 factory.go:153] Registering CRI-O factory Jun 11 15:05:23.249979 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.249905 2576 factory.go:223] Registration of the crio container factory successfully Jun 11 15:05:23.249979 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.249953 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 15:05:23.250128 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.250071 2576 factory.go:103] Registering Raw factory Jun 11 15:05:23.250128 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.250092 2576 manager.go:1196] Started watching for new ooms in manager Jun 11 15:05:23.250663 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.250649 2576 manager.go:349] Starting recovery of all containers Jun 11 15:05:23.252168 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.252144 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-38.ec2.internal\" not found" node="ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.262134 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.262119 2576 manager.go:354] Recovery completed Jun 11 15:05:23.266095 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.266082 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:05:23.267983 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.267966 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:05:23.268059 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.268005 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:05:23.268059 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.268019 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:05:23.268585 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.268568 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 15:05:23.268585 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.268578 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 15:05:23.268585 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.268583 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:05:23.268706 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.268594 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:05:23.269287 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.269274 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:05:23.269360 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.269302 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:05:23.269360 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.269311 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:05:23.269979 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.269968 2576 policy_none.go:49] "None policy: Start" Jun 11 15:05:23.270012 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.269983 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 15:05:23.270012 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.269993 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 15:05:23.271137 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.271127 2576 policy_none.go:47] "Start" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.305302 2576 manager.go:337] "Starting Device Plugin manager" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.305335 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.305346 2576 server.go:87] "Starting device plugin registration server" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.305574 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.305585 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.305699 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.305786 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.305794 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.306576 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.306617 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.315482 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.316726 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.316759 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.316777 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.316823 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 15:05:23.321661 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.318969 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:05:23.405693 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.405658 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:05:23.407011 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.406993 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:05:23.407082 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.407025 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:05:23.407082 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.407036 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:05:23.407082 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.407060 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.417143 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.417078 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal"] Jun 11 15:05:23.417143 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.417142 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:05:23.417953 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.417937 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:05:23.418046 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.417971 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:05:23.418046 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.417985 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:05:23.418160 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.418065 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.418160 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.418084 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-38.ec2.internal\": node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.419296 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419280 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:05:23.419403 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.419451 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419423 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:05:23.419955 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419935 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:05:23.419955 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419947 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:05:23.420103 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419968 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:05:23.420103 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419983 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:05:23.420103 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.419969 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:05:23.420103 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.420075 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:05:23.421373 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.421356 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.421453 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.421389 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:05:23.422081 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.422066 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:05:23.422170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.422098 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:05:23.422170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.422112 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:05:23.431953 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.431937 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.457517 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.457496 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-38.ec2.internal\" not found" node="ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.461753 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.461737 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-38.ec2.internal\" not found" node="ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.532780 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.532755 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.547947 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.547921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d558771c6220b5c3408ef98f4e323cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"4d558771c6220b5c3408ef98f4e323cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.548067 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.547958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d558771c6220b5c3408ef98f4e323cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"4d558771c6220b5c3408ef98f4e323cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.548067 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.547981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfea306d350844199848c9bdf4cc30f8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-38.ec2.internal\" (UID: \"cfea306d350844199848c9bdf4cc30f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.632890 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.632855 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.648121 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.648094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d558771c6220b5c3408ef98f4e323cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"4d558771c6220b5c3408ef98f4e323cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.648210 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.648125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfea306d350844199848c9bdf4cc30f8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-38.ec2.internal\" (UID: \"cfea306d350844199848c9bdf4cc30f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.648210 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.648143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d558771c6220b5c3408ef98f4e323cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"4d558771c6220b5c3408ef98f4e323cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.648210 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.648190 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d558771c6220b5c3408ef98f4e323cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"4d558771c6220b5c3408ef98f4e323cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.648210 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.648193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d558771c6220b5c3408ef98f4e323cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal\" (UID: \"4d558771c6220b5c3408ef98f4e323cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.648351 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.648205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfea306d350844199848c9bdf4cc30f8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-38.ec2.internal\" (UID: \"cfea306d350844199848c9bdf4cc30f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.733580 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.733515 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.761881 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.761858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.766071 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:23.766056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Jun 11 15:05:23.833855 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.833815 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:23.934263 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:23.934228 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:24.034738 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:24.034710 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:24.135217 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:24.135176 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:24.176747 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.176705 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 15:05:24.177415 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.176880 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:05:24.177415 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.176893 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:05:24.236214 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:24.236187 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:24.241373 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.241336 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 15:00:23 +0000 UTC" deadline="2028-01-03 09:53:09.260117928 +0000 UTC" Jun 11 15:05:24.241373 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.241370 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13698h47m45.018751823s" Jun 11 15:05:24.329192 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:24.329161 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfea306d350844199848c9bdf4cc30f8.slice/crio-49ceaf2faa094b7b3d965c95fc005ed7ff6384d78f7f2e07efcec8e371b7e8fd WatchSource:0}: Error finding container 49ceaf2faa094b7b3d965c95fc005ed7ff6384d78f7f2e07efcec8e371b7e8fd: Status 404 returned error can't find the container with id 49ceaf2faa094b7b3d965c95fc005ed7ff6384d78f7f2e07efcec8e371b7e8fd Jun 11 15:05:24.329988 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:24.329965 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d558771c6220b5c3408ef98f4e323cd.slice/crio-9437b05fb092e7d56f045ca57d45954a51dbe65165d358a3f2a007db4e6003f7 WatchSource:0}: Error finding container 9437b05fb092e7d56f045ca57d45954a51dbe65165d358a3f2a007db4e6003f7: Status 404 returned error can't find the container with id 9437b05fb092e7d56f045ca57d45954a51dbe65165d358a3f2a007db4e6003f7 Jun 11 15:05:24.334834 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.334795 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:05:24.336363 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:24.336346 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-38.ec2.internal\" not found" Jun 11 15:05:24.390427 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.390405 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:05:24.447863 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.447840 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" Jun 11 15:05:24.459936 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.459916 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:05:24.461641 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.461628 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" Jun 11 15:05:24.471099 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.471077 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:05:24.653903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:24.653817 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:05:25.147781 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.147746 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:05:25.222078 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.221833 2576 apiserver.go:52] "Watching apiserver" Jun 11 15:05:25.227098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.227071 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 15:05:25.228393 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.228362 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-gspjf","openshift-multus/multus-rmp9j","openshift-network-diagnostics/network-check-target-v7gx5","openshift-network-operator/iptables-alerter-cdfhm","openshift-ovn-kubernetes/ovnkube-node-fst2x","kube-system/global-pull-secret-syncer-twzmn","kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr","openshift-cluster-node-tuning-operator/tuned-xds6r","openshift-dns/node-resolver-z5sbv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-d4lzb","openshift-multus/network-metrics-daemon-m5v9x","kube-system/konnectivity-agent-jjgp5"] Jun 11 15:05:25.230745 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.230718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.233012 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.232986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:25.233139 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.233071 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:25.233139 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.233123 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 15:05:25.233248 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.233194 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 15:05:25.233291 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.233246 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l6sdm\"" Jun 11 15:05:25.235518 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.235498 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:25.235606 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.235577 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:25.236925 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.236883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.239611 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.239590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 15:05:25.239703 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.239659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:05:25.239703 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.239596 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 15:05:25.239890 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.239872 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.240006 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.239932 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mmc9h\"" Jun 11 15:05:25.241063 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.241044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.241144 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.241117 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:25.242051 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.241854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 15:05:25.242455 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.242435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 15:05:25.242528 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.242501 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 15:05:25.242528 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.242508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 15:05:25.242652 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.242636 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 15:05:25.242688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.242636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x84gl\"" Jun 11 15:05:25.242912 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.242886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.243005 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.242944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 15:05:25.244784 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.244766 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:05:25.244931 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.244914 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 15:05:25.245074 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.245056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.245584 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.245562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vblkg\"" Jun 11 15:05:25.246961 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.246933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.248621 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.247747 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 15:05:25.248621 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.248121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 15:05:25.248621 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.248364 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 15:05:25.248621 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.248367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-98t6f\"" Jun 11 15:05:25.249029 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.249000 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 15:05:25.249565 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.249524 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.249648 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.249567 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 15:05:25.250019 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.249980 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 15:05:25.250640 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.250347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cnvr7\"" Jun 11 15:05:25.250640 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.250431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 15:05:25.253614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.251849 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 15:05:25.253614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.251869 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 15:05:25.253614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.251988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 15:05:25.253614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.251850 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qmn72\"" Jun 11 15:05:25.253614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.253112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.254633 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.254613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.254952 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.254931 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 15:05:25.255658 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.255636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 15:05:25.256291 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.256272 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vndkq\"" Jun 11 15:05:25.256535 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.256521 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 15:05:25.257076 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.257057 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 15:05:25.257304 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.257273 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 15:05:25.257512 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.257497 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8h92c\"" Jun 11 15:05:25.259820 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.259783 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-tmp\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-slash\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-dbus\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysctl-conf\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nstp\" (UniqueName: \"kubernetes.io/projected/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-kube-api-access-7nstp\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-netns\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-cni-bin\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-node-log\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-cni-bin\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-sys\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/854ff2b6-eb12-4d4d-b1af-04343ec3bfcb-agent-certs\") pod \"konnectivity-agent-jjgp5\" (UID: \"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb\") " pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-os-release\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-kubelet\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-systemd-units\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-etc-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.261819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-systemd\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-cnibin\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7s5f\" (UniqueName: \"kubernetes.io/projected/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-kube-api-access-g7s5f\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd6407d6-55b8-412b-a1ac-bd64d6c88938-host\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-log-socket\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovn-node-metrics-cert\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-tuned\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-k8s-cni-cncf-io\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-daemon-config\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-var-lib-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovnkube-script-lib\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.261995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h24rg\" (UniqueName: \"kubernetes.io/projected/d2e02bba-c707-41b7-9dad-f990094c0bb4-kube-api-access-h24rg\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-multus-certs\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzjh\" (UniqueName: \"kubernetes.io/projected/170a715a-3c6b-4fd8-ac68-5607f70b88ce-kube-api-access-6vzjh\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-systemd\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-lib-modules\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.262659 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-iptables-alerter-script\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/854ff2b6-eb12-4d4d-b1af-04343ec3bfcb-konnectivity-ca\") pod \"konnectivity-agent-jjgp5\" (UID: \"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb\") " pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd6407d6-55b8-412b-a1ac-bd64d6c88938-serviceca\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovnkube-config\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvx4s\" (UniqueName: \"kubernetes.io/projected/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-kube-api-access-hvx4s\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-var-lib-kubelet\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-cni-multus\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-kubelet\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-run-netns\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-socket-dir-parent\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvvx\" (UniqueName: \"kubernetes.io/projected/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-kube-api-access-whvvx\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysconfig\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysctl-d\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-host-slash\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.263405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-conf-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-hosts-file\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-modprobe-d\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-cni-netd\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-env-overrides\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-kubelet-config\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-host\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-system-cni-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-etc-kubernetes\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-tmp-dir\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-ovn\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-cni-binary-copy\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-kubernetes\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.262996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-run\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.263018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-cni-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.264170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.263041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-hostroot\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.264881 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.263079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxxz6\" (UniqueName: \"kubernetes.io/projected/fd6407d6-55b8-412b-a1ac-bd64d6c88938-kube-api-access-qxxz6\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.264881 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.263114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:25.311985 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.311949 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d67bj" Jun 11 15:05:25.321645 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.321589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" event={"ID":"cfea306d350844199848c9bdf4cc30f8","Type":"ContainerStarted","Data":"49ceaf2faa094b7b3d965c95fc005ed7ff6384d78f7f2e07efcec8e371b7e8fd"} Jun 11 15:05:25.322835 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.322795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" event={"ID":"4d558771c6220b5c3408ef98f4e323cd","Type":"ContainerStarted","Data":"9437b05fb092e7d56f045ca57d45954a51dbe65165d358a3f2a007db4e6003f7"} Jun 11 15:05:25.324277 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.324258 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d67bj" Jun 11 15:05:25.348755 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.348725 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 15:05:25.364320 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvvx\" (UniqueName: \"kubernetes.io/projected/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-kube-api-access-whvvx\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.364320 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.364517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysconfig\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.364517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysctl-d\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.364517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysconfig\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.364517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-host-slash\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.364517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-conf-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-host-slash\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364487 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysctl-d\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-hosts-file\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-system-cni-dir\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-hosts-file\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-modprobe-d\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-conf-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-cni-netd\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-env-overrides\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-cni-netd\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.364757 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-modprobe-d\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-kubelet-config\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-host\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-system-cni-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-etc-kubernetes\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-host\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-tmp-dir\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-socket-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-etc-kubernetes\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-kubelet-config\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-etc-selinux\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-system-cni-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5h9z\" (UniqueName: \"kubernetes.io/projected/432adce1-213f-43c7-b2f4-39fc4b447792-kube-api-access-f5h9z\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.364988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-ovn\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-cni-binary-copy\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.365302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-kubernetes\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-ovn\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365149 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-kubernetes\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-env-overrides\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-run\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-run\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-cni-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-hostroot\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-tmp-dir\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxxz6\" (UniqueName: \"kubernetes.io/projected/fd6407d6-55b8-412b-a1ac-bd64d6c88938-kube-api-access-qxxz6\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-cni-dir\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-hostroot\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-registration-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-tmp\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-device-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.365399 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:25.366122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cnibin\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-slash\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-dbus\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-slash\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.365507 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:25.865464806 +0000 UTC m=+2.982956721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-dbus\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysctl-conf\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nstp\" (UniqueName: \"kubernetes.io/projected/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-kube-api-access-7nstp\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-netns\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-cni-binary-copy\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-cni-bin\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-sysctl-conf\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-netns\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-node-log\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-cni-bin\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-node-log\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-cni-bin\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365774 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-run-ovn-kubernetes\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-cni-bin\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-sys\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/854ff2b6-eb12-4d4d-b1af-04343ec3bfcb-agent-certs\") pod \"konnectivity-agent-jjgp5\" (UID: \"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb\") " pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-sys\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-os-release\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-os-release\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-kubelet\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.365989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-systemd-units\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-kubelet\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-etc-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-systemd\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-systemd-units\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-cnibin\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7s5f\" (UniqueName: \"kubernetes.io/projected/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-kube-api-access-g7s5f\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.367790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-etc-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-systemd\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd6407d6-55b8-412b-a1ac-bd64d6c88938-host\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-cnibin\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd6407d6-55b8-412b-a1ac-bd64d6c88938-host\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-os-release\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-log-socket\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovn-node-metrics-cert\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366257 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-log-socket\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-tuned\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-k8s-cni-cncf-io\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-daemon-config\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-sys-fs\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jq8\" (UniqueName: \"kubernetes.io/projected/7f5a061b-0416-4ce6-8594-9ac9f0a789af-kube-api-access-75jq8\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-k8s-cni-cncf-io\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-var-lib-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.368625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovnkube-script-lib\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h24rg\" (UniqueName: \"kubernetes.io/projected/d2e02bba-c707-41b7-9dad-f990094c0bb4-kube-api-access-h24rg\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-multus-certs\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzjh\" (UniqueName: \"kubernetes.io/projected/170a715a-3c6b-4fd8-ac68-5607f70b88ce-kube-api-access-6vzjh\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-systemd\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-lib-modules\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-iptables-alerter-script\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366815 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-daemon-config\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/854ff2b6-eb12-4d4d-b1af-04343ec3bfcb-konnectivity-ca\") pod \"konnectivity-agent-jjgp5\" (UID: \"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb\") " pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd6407d6-55b8-412b-a1ac-bd64d6c88938-serviceca\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovnkube-config\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvx4s\" (UniqueName: \"kubernetes.io/projected/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-kube-api-access-hvx4s\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.366994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-run-multus-certs\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovnkube-script-lib\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-var-lib-openvswitch\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-run-systemd\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-lib-modules\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovnkube-config\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/854ff2b6-eb12-4d4d-b1af-04343ec3bfcb-konnectivity-ca\") pod \"konnectivity-agent-jjgp5\" (UID: \"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb\") " pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.367784 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.367863 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret podName:f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32 nodeName:}" failed. No retries permitted until 2026-06-11 15:05:25.867847258 +0000 UTC m=+2.985339158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret") pod "global-pull-secret-syncer-twzmn" (UID: "f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-iptables-alerter-script\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd6407d6-55b8-412b-a1ac-bd64d6c88938-serviceca\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-var-lib-kubelet\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.367999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-var-lib-kubelet\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-cni-multus\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-kubelet\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-host-var-lib-cni-multus\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-run-netns\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-socket-dir-parent\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.369945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-kubelet\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.370491 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-multus-socket-dir-parent\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.370491 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.368220 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2e02bba-c707-41b7-9dad-f990094c0bb4-host-run-netns\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.370491 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.369114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-tmp\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.370491 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.369332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/854ff2b6-eb12-4d4d-b1af-04343ec3bfcb-agent-certs\") pod \"konnectivity-agent-jjgp5\" (UID: \"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb\") " pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.370491 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.369150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-etc-tuned\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.370491 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.369605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2e02bba-c707-41b7-9dad-f990094c0bb4-ovn-node-metrics-cert\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.370711 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.370521 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:05:25.370711 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.370540 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:05:25.370711 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.370553 2576 projected.go:196] Error preparing data for projected volume kube-api-access-74ggw for pod openshift-network-diagnostics/network-check-target-v7gx5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:25.370711 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.370618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw podName:ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:25.870600901 +0000 UTC m=+2.988092800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-74ggw" (UniqueName: "kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw") pod "network-check-target-v7gx5" (UID: "ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:25.376507 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.376479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nstp\" (UniqueName: \"kubernetes.io/projected/a416f1f7-6b7c-4aaa-8108-14aac960b0bf-kube-api-access-7nstp\") pod \"iptables-alerter-cdfhm\" (UID: \"a416f1f7-6b7c-4aaa-8108-14aac960b0bf\") " pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.376631 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.376526 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxxz6\" (UniqueName: \"kubernetes.io/projected/fd6407d6-55b8-412b-a1ac-bd64d6c88938-kube-api-access-qxxz6\") pod \"node-ca-gspjf\" (UID: \"fd6407d6-55b8-412b-a1ac-bd64d6c88938\") " pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.376631 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.376621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvvx\" (UniqueName: \"kubernetes.io/projected/5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75-kube-api-access-whvvx\") pod \"node-resolver-z5sbv\" (UID: \"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75\") " pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.378369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.378348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h24rg\" (UniqueName: \"kubernetes.io/projected/d2e02bba-c707-41b7-9dad-f990094c0bb4-kube-api-access-h24rg\") pod \"ovnkube-node-fst2x\" (UID: \"d2e02bba-c707-41b7-9dad-f990094c0bb4\") " pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.378466 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.378436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7s5f\" (UniqueName: \"kubernetes.io/projected/e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5-kube-api-access-g7s5f\") pod \"multus-rmp9j\" (UID: \"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5\") " pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.378614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.378595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzjh\" (UniqueName: \"kubernetes.io/projected/170a715a-3c6b-4fd8-ac68-5607f70b88ce-kube-api-access-6vzjh\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:25.378919 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.378842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvx4s\" (UniqueName: \"kubernetes.io/projected/dc4b7a27-4a1e-4858-a34f-16ea10b79a0f-kube-api-access-hvx4s\") pod \"tuned-xds6r\" (UID: \"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f\") " pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.469179 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-registration-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469179 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-device-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469179 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cnibin\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-os-release\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469235 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-registration-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-os-release\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469235 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-device-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469381 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cnibin\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-sys-fs\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jq8\" (UniqueName: \"kubernetes.io/projected/7f5a061b-0416-4ce6-8594-9ac9f0a789af-kube-api-access-75jq8\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-sys-fs\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-system-cni-dir\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-socket-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-etc-selinux\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5h9z\" (UniqueName: \"kubernetes.io/projected/432adce1-213f-43c7-b2f4-39fc4b447792-kube-api-access-f5h9z\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f5a061b-0416-4ce6-8594-9ac9f0a789af-system-cni-dir\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.469886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.470370 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.469950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-etc-selinux\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.470370 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.470044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/432adce1-213f-43c7-b2f4-39fc4b447792-socket-dir\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.470370 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.470318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.470680 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.470661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f5a061b-0416-4ce6-8594-9ac9f0a789af-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.479123 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.479102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5h9z\" (UniqueName: \"kubernetes.io/projected/432adce1-213f-43c7-b2f4-39fc4b447792-kube-api-access-f5h9z\") pod \"aws-ebs-csi-driver-node-mbdsr\" (UID: \"432adce1-213f-43c7-b2f4-39fc4b447792\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.479235 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.479147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jq8\" (UniqueName: \"kubernetes.io/projected/7f5a061b-0416-4ce6-8594-9ac9f0a789af-kube-api-access-75jq8\") pod \"multus-additional-cni-plugins-d4lzb\" (UID: \"7f5a061b-0416-4ce6-8594-9ac9f0a789af\") " pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.543022 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.542970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z5sbv" Jun 11 15:05:25.557022 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.556995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cdfhm" Jun 11 15:05:25.565954 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.565931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:25.572145 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.572118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xds6r" Jun 11 15:05:25.579013 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.578995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:25.586461 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.586443 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmp9j" Jun 11 15:05:25.591299 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.591282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gspjf" Jun 11 15:05:25.598264 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.598244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" Jun 11 15:05:25.603756 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.603739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" Jun 11 15:05:25.777570 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.777541 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:05:25.872761 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.872727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:25.872943 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.872778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:25.872943 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:25.872846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:25.872943 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.872907 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:25.872943 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.872940 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:05:25.873098 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.872959 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:05:25.873098 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.872966 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:25.873098 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.872972 2576 projected.go:196] Error preparing data for projected volume kube-api-access-74ggw for pod openshift-network-diagnostics/network-check-target-v7gx5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:25.873098 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.872986 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret podName:f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32 nodeName:}" failed. No retries permitted until 2026-06-11 15:05:26.872966775 +0000 UTC m=+3.990458672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret") pod "global-pull-secret-syncer-twzmn" (UID: "f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:25.873098 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.873008 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw podName:ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:26.872997465 +0000 UTC m=+3.990489365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-74ggw" (UniqueName: "kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw") pod "network-check-target-v7gx5" (UID: "ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:25.873098 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:25.873024 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:26.873016597 +0000 UTC m=+3.990508491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:26.175562 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.175526 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432adce1_213f_43c7_b2f4_39fc4b447792.slice/crio-04539c50a8d69499709ac31aaab406784595da5f9f7205d61ee3d59270ef45f9 WatchSource:0}: Error finding container 04539c50a8d69499709ac31aaab406784595da5f9f7205d61ee3d59270ef45f9: Status 404 returned error can't find the container with id 04539c50a8d69499709ac31aaab406784595da5f9f7205d61ee3d59270ef45f9 Jun 11 15:05:26.176646 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.176618 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5686dd6e_a8a0_4bf5_9253_4cf0b02a1f75.slice/crio-63ab3d098b98a90e44aa2572b379fbfce9d057eae5b9c754ff20edc644cb5303 WatchSource:0}: Error finding container 63ab3d098b98a90e44aa2572b379fbfce9d057eae5b9c754ff20edc644cb5303: Status 404 returned error can't find the container with id 63ab3d098b98a90e44aa2572b379fbfce9d057eae5b9c754ff20edc644cb5303 Jun 11 15:05:26.178171 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.178119 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda416f1f7_6b7c_4aaa_8108_14aac960b0bf.slice/crio-1bb98c544d5fc130c427022b59246b5fc0ceff006bca0f70a0c157cf7bad1631 WatchSource:0}: Error finding container 1bb98c544d5fc130c427022b59246b5fc0ceff006bca0f70a0c157cf7bad1631: Status 404 returned error can't find the container with id 1bb98c544d5fc130c427022b59246b5fc0ceff006bca0f70a0c157cf7bad1631 Jun 11 15:05:26.181570 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.181508 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5a061b_0416_4ce6_8594_9ac9f0a789af.slice/crio-9b707ce481472146f18f6b688241b5ce5f9fc2186d3d9da999696b809c75d286 WatchSource:0}: Error finding container 9b707ce481472146f18f6b688241b5ce5f9fc2186d3d9da999696b809c75d286: Status 404 returned error can't find the container with id 9b707ce481472146f18f6b688241b5ce5f9fc2186d3d9da999696b809c75d286 Jun 11 15:05:26.182179 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.182157 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854ff2b6_eb12_4d4d_b1af_04343ec3bfcb.slice/crio-d15658ea6470905703086edd80e34e26e0379e0b25e2093f2b86a34923a6cb43 WatchSource:0}: Error finding container d15658ea6470905703086edd80e34e26e0379e0b25e2093f2b86a34923a6cb43: Status 404 returned error can't find the container with id d15658ea6470905703086edd80e34e26e0379e0b25e2093f2b86a34923a6cb43 Jun 11 15:05:26.184371 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.184347 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45c0e9a_58a9_489c_8db4_44c4b0ed9ff5.slice/crio-3cf9b46c63eae41a3461b6c721fe6a14fc48d2e3dc6c08eb0f4925713a109350 WatchSource:0}: Error finding container 3cf9b46c63eae41a3461b6c721fe6a14fc48d2e3dc6c08eb0f4925713a109350: Status 404 returned error can't find the container with id 3cf9b46c63eae41a3461b6c721fe6a14fc48d2e3dc6c08eb0f4925713a109350 Jun 11 15:05:26.185881 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.185865 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6407d6_55b8_412b_a1ac_bd64d6c88938.slice/crio-6cd12314f5f8050e3e3fd91f130ef51f68a0f28e0e7325d533244c813b96696e WatchSource:0}: Error finding container 6cd12314f5f8050e3e3fd91f130ef51f68a0f28e0e7325d533244c813b96696e: Status 404 returned error can't find the container with id 6cd12314f5f8050e3e3fd91f130ef51f68a0f28e0e7325d533244c813b96696e Jun 11 15:05:26.186843 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.186786 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4b7a27_4a1e_4858_a34f_16ea10b79a0f.slice/crio-58b73bc03124111e31325bc3fb7fe3f5626fbaf196373a3b0a8a499a5a9f7c27 WatchSource:0}: Error finding container 58b73bc03124111e31325bc3fb7fe3f5626fbaf196373a3b0a8a499a5a9f7c27: Status 404 returned error can't find the container with id 58b73bc03124111e31325bc3fb7fe3f5626fbaf196373a3b0a8a499a5a9f7c27 Jun 11 15:05:26.188373 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:26.188301 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e02bba_c707_41b7_9dad_f990094c0bb4.slice/crio-7b971bd68b90b5a687f306651c82729e14e28e3109f3e54593e19a706d070baf WatchSource:0}: Error finding container 7b971bd68b90b5a687f306651c82729e14e28e3109f3e54593e19a706d070baf: Status 404 returned error can't find the container with id 7b971bd68b90b5a687f306651c82729e14e28e3109f3e54593e19a706d070baf Jun 11 15:05:26.326561 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.326471 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:00:25 +0000 UTC" deadline="2028-02-22 14:12:55.800865198 +0000 UTC" Jun 11 15:05:26.326561 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.326520 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14903h7m29.474348921s" Jun 11 15:05:26.327098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.326899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"7b971bd68b90b5a687f306651c82729e14e28e3109f3e54593e19a706d070baf"} Jun 11 15:05:26.328727 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.328677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xds6r" event={"ID":"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f","Type":"ContainerStarted","Data":"58b73bc03124111e31325bc3fb7fe3f5626fbaf196373a3b0a8a499a5a9f7c27"} Jun 11 15:05:26.330129 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.330083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjgp5" event={"ID":"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb","Type":"ContainerStarted","Data":"d15658ea6470905703086edd80e34e26e0379e0b25e2093f2b86a34923a6cb43"} Jun 11 15:05:26.331166 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.331143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerStarted","Data":"9b707ce481472146f18f6b688241b5ce5f9fc2186d3d9da999696b809c75d286"} Jun 11 15:05:26.332241 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.332221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cdfhm" event={"ID":"a416f1f7-6b7c-4aaa-8108-14aac960b0bf","Type":"ContainerStarted","Data":"1bb98c544d5fc130c427022b59246b5fc0ceff006bca0f70a0c157cf7bad1631"} Jun 11 15:05:26.334559 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.334526 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" event={"ID":"cfea306d350844199848c9bdf4cc30f8","Type":"ContainerStarted","Data":"68ba4fd78d3b5aed5cf1b07c7f8aca575febcba6d28b5d662f7d1ccb8cce90f9"} Jun 11 15:05:26.335517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.335489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gspjf" event={"ID":"fd6407d6-55b8-412b-a1ac-bd64d6c88938","Type":"ContainerStarted","Data":"6cd12314f5f8050e3e3fd91f130ef51f68a0f28e0e7325d533244c813b96696e"} Jun 11 15:05:26.336636 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.336613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmp9j" event={"ID":"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5","Type":"ContainerStarted","Data":"3cf9b46c63eae41a3461b6c721fe6a14fc48d2e3dc6c08eb0f4925713a109350"} Jun 11 15:05:26.337986 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.337963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z5sbv" event={"ID":"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75","Type":"ContainerStarted","Data":"63ab3d098b98a90e44aa2572b379fbfce9d057eae5b9c754ff20edc644cb5303"} Jun 11 15:05:26.338945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.338924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" event={"ID":"432adce1-213f-43c7-b2f4-39fc4b447792","Type":"ContainerStarted","Data":"04539c50a8d69499709ac31aaab406784595da5f9f7205d61ee3d59270ef45f9"} Jun 11 15:05:26.353488 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.353439 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-38.ec2.internal" podStartSLOduration=2.353419744 podStartE2EDuration="2.353419744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:26.353174012 +0000 UTC m=+3.470665920" watchObservedRunningTime="2026-06-11 15:05:26.353419744 +0000 UTC m=+3.470911679" Jun 11 15:05:26.882187 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.882151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:26.882385 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.882214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:26.882385 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:26.882253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:26.882513 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.882386 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:26.882513 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.882498 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:28.882472696 +0000 UTC m=+5.999964610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:26.882935 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.882914 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:26.883038 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.882972 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret podName:f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32 nodeName:}" failed. No retries permitted until 2026-06-11 15:05:28.882955427 +0000 UTC m=+6.000447341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret") pod "global-pull-secret-syncer-twzmn" (UID: "f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:26.883107 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.883066 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:05:26.883107 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.883081 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:05:26.883107 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.883094 2576 projected.go:196] Error preparing data for projected volume kube-api-access-74ggw for pod openshift-network-diagnostics/network-check-target-v7gx5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:26.883251 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:26.883130 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw podName:ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:28.883118736 +0000 UTC m=+6.000610647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-74ggw" (UniqueName: "kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw") pod "network-check-target-v7gx5" (UID: "ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:27.327186 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:27.327153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:27.327717 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:27.327391 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:27.327717 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:27.327495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:27.327717 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:27.327588 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:27.327717 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:27.327646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:27.327717 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:27.327710 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:27.328140 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:27.328112 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:00:25 +0000 UTC" deadline="2027-11-27 09:35:28.201546266 +0000 UTC" Jun 11 15:05:27.328227 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:27.328141 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12810h30m0.87340952s" Jun 11 15:05:27.351857 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:27.351823 2576 generic.go:356] "Generic (PLEG): container finished" podID="4d558771c6220b5c3408ef98f4e323cd" containerID="f55b492d90157110c5b2a43a059733d8cdde2ee369ba7ac83e04b0970f5d669f" exitCode=0 Jun 11 15:05:27.352843 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:27.352795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" event={"ID":"4d558771c6220b5c3408ef98f4e323cd","Type":"ContainerDied","Data":"f55b492d90157110c5b2a43a059733d8cdde2ee369ba7ac83e04b0970f5d669f"} Jun 11 15:05:28.369477 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:28.368708 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" event={"ID":"4d558771c6220b5c3408ef98f4e323cd","Type":"ContainerStarted","Data":"c17a93ecf2684b71652fde8bacb86d2c2afae723836aa11dd45928243d6e07e4"} Jun 11 15:05:28.907114 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:28.907073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:28.907315 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:28.907140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:28.907315 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:28.907181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:28.907439 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.907322 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:28.907439 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.907384 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:32.907365898 +0000 UTC m=+10.024857808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:28.907794 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.907763 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:28.907886 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.907846 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret podName:f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32 nodeName:}" failed. No retries permitted until 2026-06-11 15:05:32.907829165 +0000 UTC m=+10.025321062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret") pod "global-pull-secret-syncer-twzmn" (UID: "f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:28.907952 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.907931 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:05:28.908013 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.907959 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:05:28.908013 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.907972 2576 projected.go:196] Error preparing data for projected volume kube-api-access-74ggw for pod openshift-network-diagnostics/network-check-target-v7gx5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:28.908113 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:28.908015 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw podName:ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:32.908001837 +0000 UTC m=+10.025493762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-74ggw" (UniqueName: "kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw") pod "network-check-target-v7gx5" (UID: "ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:29.319564 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:29.319528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:29.319733 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:29.319672 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:29.320085 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:29.320066 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:29.320200 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:29.320179 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:29.320268 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:29.320241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:29.320318 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:29.320307 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:31.320427 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:31.319644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:31.320427 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:31.319779 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:31.320427 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:31.320174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:31.320427 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:31.320278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:31.320427 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:31.320318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:31.320427 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:31.320379 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:32.944075 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:32.944027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:32.944184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944236 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944267 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944283 2576 projected.go:196] Error preparing data for projected volume kube-api-access-74ggw for pod openshift-network-diagnostics/network-check-target-v7gx5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944333 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944350 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw podName:ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:40.94432987 +0000 UTC m=+18.061821785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-74ggw" (UniqueName: "kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw") pod "network-check-target-v7gx5" (UID: "ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944361 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:32.944247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944398 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:40.944378742 +0000 UTC m=+18.061870656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:32.944541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:32.944418 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret podName:f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32 nodeName:}" failed. No retries permitted until 2026-06-11 15:05:40.944408329 +0000 UTC m=+18.061900222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret") pod "global-pull-secret-syncer-twzmn" (UID: "f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:33.320097 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:33.320067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:33.320273 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:33.320203 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:33.320573 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:33.320550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:33.320573 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:33.320571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:33.320703 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:33.320660 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:33.320761 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:33.320737 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:35.317975 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:35.317941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:35.318443 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:35.318071 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:35.318443 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:35.318410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:35.318534 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:35.318497 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:35.318585 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:35.318560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:35.318651 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:35.318636 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:37.317989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:37.317954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:37.318442 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:37.317955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:37.318442 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:37.318097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:37.318442 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:37.317959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:37.318442 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:37.318154 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:37.318442 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:37.318250 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:39.317528 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:39.317497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:39.317528 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:39.317527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:39.318064 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:39.317497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:39.318064 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:39.317641 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:39.318064 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:39.317752 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:39.318064 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:39.317989 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:41.009502 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:41.009459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:41.010062 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:41.009527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:41.010062 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:41.009561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:41.010062 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.009699 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:05:41.010062 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.009716 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:05:41.010062 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.009728 2576 projected.go:196] Error preparing data for projected volume kube-api-access-74ggw for pod openshift-network-diagnostics/network-check-target-v7gx5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:41.010062 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.009785 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw podName:ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:57.009765778 +0000 UTC m=+34.127257696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-74ggw" (UniqueName: "kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw") pod "network-check-target-v7gx5" (UID: "ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:41.010401 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.010133 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:41.010401 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.010169 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:05:57.010158637 +0000 UTC m=+34.127650530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:41.010401 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.010207 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:41.010401 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.010229 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret podName:f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32 nodeName:}" failed. No retries permitted until 2026-06-11 15:05:57.010222128 +0000 UTC m=+34.127714022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret") pod "global-pull-secret-syncer-twzmn" (UID: "f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:41.317578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:41.317543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:41.317762 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:41.317546 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:41.317762 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.317658 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:41.317762 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:41.317548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:41.317911 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.317733 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:41.317911 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:41.317860 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:43.317972 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:43.317941 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:43.318460 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:43.318064 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:43.318460 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:43.318423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:43.318573 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:43.318509 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:43.318573 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:43.318550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:43.318681 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:43.318618 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:45.318933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:45.318114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:45.318933 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:45.318396 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:45.318933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:45.318242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:45.318933 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:45.318491 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:45.318933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:45.318126 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:45.318933 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:45.318595 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:45.414241 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:45.414210 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjgp5" event={"ID":"854ff2b6-eb12-4d4d-b1af-04343ec3bfcb","Type":"ContainerStarted","Data":"6c71bf554dd8d4360f1851c22ce4d1c0a8229bca32f04f0d8ecf9591d6a32f23"} Jun 11 15:05:45.428214 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:45.427961 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-38.ec2.internal" podStartSLOduration=21.427941696 podStartE2EDuration="21.427941696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:28.387362603 +0000 UTC m=+5.504854519" watchObservedRunningTime="2026-06-11 15:05:45.427941696 +0000 UTC m=+22.545433608" Jun 11 15:05:45.428313 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:45.428205 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jjgp5" podStartSLOduration=11.913879251000001 podStartE2EDuration="22.42819367s" totalImagesPullingTime="10.514314419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:45.426949931 +0000 UTC m=+22.544441858" watchObservedRunningTime="2026-06-11 15:05:45.42819367 +0000 UTC m=+22.545685587" Jun 11 15:05:46.248191 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.248167 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 15:05:46.319122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.318931 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T15:05:46.248188168Z","UUID":"6759a14b-9db0-49a4-8de6-7fbd03f378a7","Handler":null,"Name":"","Endpoint":""} Jun 11 15:05:46.320712 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.320694 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 15:05:46.320819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.320736 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 15:05:46.419164 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.419134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gspjf" event={"ID":"fd6407d6-55b8-412b-a1ac-bd64d6c88938","Type":"ContainerStarted","Data":"2d09e1332290088402c90f578eb6f61b616b92a09e3a2213832ecea6aba4abce"} Jun 11 15:05:46.420550 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.420525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmp9j" event={"ID":"e45c0e9a-58a9-489c-8db4-44c4b0ed9ff5","Type":"ContainerStarted","Data":"0eada38e6d38a8dba6f84173aa45711bbf6f20d4fc380c648004f4611b467df2"} Jun 11 15:05:46.421857 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.421833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z5sbv" event={"ID":"5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75","Type":"ContainerStarted","Data":"013d2b26db109ae322c2405e4a79e58b49f6e58ab3c6cbc1a2aced7560a9080a"} Jun 11 15:05:46.423449 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.423428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" event={"ID":"432adce1-213f-43c7-b2f4-39fc4b447792","Type":"ContainerStarted","Data":"b84d0a6b1f21889952cce0299ecaf5da4baa4825dd9de13f955f3c4d1eba6d0f"} Jun 11 15:05:46.423530 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.423471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" event={"ID":"432adce1-213f-43c7-b2f4-39fc4b447792","Type":"ContainerStarted","Data":"9078b2b1d9104bea49e31b2059bfe967d92d63d403c25e4feb8bd404c256ff75"} Jun 11 15:05:46.426270 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.426250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"d55ca3f97395e950885835f7b29c41a0029637318e7ceb2541f02509b94a24c8"} Jun 11 15:05:46.426363 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.426309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"d00f1772ad26b3c36736675b7840cb12d7afce1e9c8a80728a6685555401095a"} Jun 11 15:05:46.426363 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.426343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"2f8de80435e3843abdef2fa33a9f5849593ccd8d16f96e2a8d6ab2e2d2faa2fe"} Jun 11 15:05:46.426475 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.426386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"348e629b4dc2e34e12cbf7c1ec59bc4bbb77dc9cd110ebad282845128b897026"} Jun 11 15:05:46.426475 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.426419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"6a751a2cf0cb95bf3cedfeed707a5357f1d92e16cffcbfa231d666b2381af05a"} Jun 11 15:05:46.426475 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.426448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"e2efd2ab879e398af7793c3455fe659bb68f89f6d8f4861431074a832260cd7e"} Jun 11 15:05:46.427546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.427525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xds6r" event={"ID":"dc4b7a27-4a1e-4858-a34f-16ea10b79a0f","Type":"ContainerStarted","Data":"e9183c3d62a52a80d9d985d23d0976a57f76471e4fc18ec18fa68f1f255a6b37"} Jun 11 15:05:46.428920 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.428898 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5a061b-0416-4ce6-8594-9ac9f0a789af" containerID="904a48b8e0b34225a87d20aae66d9d898c9db86cc7aa94f66f8c605b35789eb4" exitCode=0 Jun 11 15:05:46.429002 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.428983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerDied","Data":"904a48b8e0b34225a87d20aae66d9d898c9db86cc7aa94f66f8c605b35789eb4"} Jun 11 15:05:46.435283 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.435248 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gspjf" podStartSLOduration=4.414443204 podStartE2EDuration="23.435237263s" totalImagesPullingTime="19.020794059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:46.434692941 +0000 UTC m=+23.552184857" watchObservedRunningTime="2026-06-11 15:05:46.435237263 +0000 UTC m=+23.552729200" Jun 11 15:05:46.448504 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.448468 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z5sbv" podStartSLOduration=4.41853478 podStartE2EDuration="23.448456899s" totalImagesPullingTime="19.029922119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:46.448047851 +0000 UTC m=+23.565539768" watchObservedRunningTime="2026-06-11 15:05:46.448456899 +0000 UTC m=+23.565948814" Jun 11 15:05:46.463473 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.463436 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xds6r" podStartSLOduration=4.419873374 podStartE2EDuration="23.463423986s" totalImagesPullingTime="19.043550612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:46.463007798 +0000 UTC m=+23.580499714" watchObservedRunningTime="2026-06-11 15:05:46.463423986 +0000 UTC m=+23.580915906" Jun 11 15:05:46.506430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:46.506392 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rmp9j" podStartSLOduration=4.460341967 podStartE2EDuration="23.506379697s" totalImagesPullingTime="19.04603773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:46.483178242 +0000 UTC m=+23.600670169" watchObservedRunningTime="2026-06-11 15:05:46.506379697 +0000 UTC m=+23.623871614" Jun 11 15:05:47.293372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.293150 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:47.293746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.293725 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:47.318056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.317985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:47.318056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.318008 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:47.318239 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.317991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:47.318239 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:47.318099 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:47.318239 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:47.318221 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:47.318383 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:47.318306 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:47.432853 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.432790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cdfhm" event={"ID":"a416f1f7-6b7c-4aaa-8108-14aac960b0bf","Type":"ContainerStarted","Data":"65e86d18f211064b4ae741f63712c9fd53e674bb8f9c625de20834b7b03b457c"} Jun 11 15:05:47.435576 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.435087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" event={"ID":"432adce1-213f-43c7-b2f4-39fc4b447792","Type":"ContainerStarted","Data":"4fb04b8ee48599a33260647e3322cb9b5bdef0c6b6994c5e151fc127e4eebb97"} Jun 11 15:05:47.435576 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.435453 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:47.436342 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.436324 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jjgp5" Jun 11 15:05:47.469778 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.469728 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mbdsr" podStartSLOduration=3.944232766 podStartE2EDuration="24.469709765s" totalImagesPullingTime="20.525476999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:47.469669943 +0000 UTC m=+24.587161859" watchObservedRunningTime="2026-06-11 15:05:47.469709765 +0000 UTC m=+24.587201682" Jun 11 15:05:47.470338 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:47.470310 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cdfhm" podStartSLOduration=5.442318285 podStartE2EDuration="24.470300157s" totalImagesPullingTime="19.027981872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:47.452639715 +0000 UTC m=+24.570131635" watchObservedRunningTime="2026-06-11 15:05:47.470300157 +0000 UTC m=+24.587792073" Jun 11 15:05:48.441762 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:48.441724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"fa430768b1db29764b2b1c6a1442203b593454b0d898ff7182f7c934000b528e"} Jun 11 15:05:49.317497 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:49.317461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:49.317497 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:49.317493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:49.317739 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:49.317462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:49.317739 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:49.317608 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:49.317879 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:49.317738 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:49.317879 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:49.317863 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:51.318298 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.318061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:51.318920 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.318067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:51.318920 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:51.318413 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:51.318920 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.318118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:51.318920 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:51.318438 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:51.318920 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:51.318533 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:51.452069 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.452031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" event={"ID":"d2e02bba-c707-41b7-9dad-f990094c0bb4","Type":"ContainerStarted","Data":"3bcf7e0f76e52200770d790d57bc3d569d6a54971fa70ae58b1e8ae33d0512ac"} Jun 11 15:05:51.452338 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.452319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:51.453958 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.453922 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5a061b-0416-4ce6-8594-9ac9f0a789af" containerID="da80c449a4449d96d148f4e0cb4b941bfddfe98b83a2c9aa2a09048bd044ca0a" exitCode=0 Jun 11 15:05:51.454040 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.453972 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerDied","Data":"da80c449a4449d96d148f4e0cb4b941bfddfe98b83a2c9aa2a09048bd044ca0a"} Jun 11 15:05:51.468456 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.468436 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:51.478592 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:51.478551 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" podStartSLOduration=9.382103677 podStartE2EDuration="28.478540277s" totalImagesPullingTime="19.0964366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:05:51.477698928 +0000 UTC m=+28.595190841" watchObservedRunningTime="2026-06-11 15:05:51.478540277 +0000 UTC m=+28.596032192" Jun 11 15:05:52.443857 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.443632 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m5v9x"] Jun 11 15:05:52.444197 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.443979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:52.444197 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:52.444065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:52.446655 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.446636 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-twzmn"] Jun 11 15:05:52.446754 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.446740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:52.446862 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:52.446844 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:52.448020 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.447985 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v7gx5"] Jun 11 15:05:52.448113 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.448098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:52.448221 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:52.448196 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:52.457346 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.457325 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:52.457503 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.457491 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:52.476841 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:52.476754 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:05:53.460572 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:53.460539 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5a061b-0416-4ce6-8594-9ac9f0a789af" containerID="b217207b3b0931580ee04613a384080c3c51de93c75be62a6687e6f77a9d49fa" exitCode=0 Jun 11 15:05:53.461241 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:53.460627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerDied","Data":"b217207b3b0931580ee04613a384080c3c51de93c75be62a6687e6f77a9d49fa"} Jun 11 15:05:54.317850 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:54.317820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:54.317995 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:54.317923 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:54.317995 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:54.317827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:54.317995 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:54.317835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:54.318095 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:54.318006 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:54.318095 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:54.318067 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:55.466864 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:55.466821 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5a061b-0416-4ce6-8594-9ac9f0a789af" containerID="7780aa64a21b03100afdf01ecc7556f99ad0b347c2aa1bb026a387f91187ba6f" exitCode=0 Jun 11 15:05:55.467332 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:55.466877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerDied","Data":"7780aa64a21b03100afdf01ecc7556f99ad0b347c2aa1bb026a387f91187ba6f"} Jun 11 15:05:56.317924 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:56.317890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:56.317924 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:56.317919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:56.318169 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:56.317890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:56.318169 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:56.318012 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v7gx5" podUID="ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce" Jun 11 15:05:56.318169 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:56.318127 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m5v9x" podUID="170a715a-3c6b-4fd8-ac68-5607f70b88ce" Jun 11 15:05:56.318302 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:56.318228 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-twzmn" podUID="f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32" Jun 11 15:05:57.027098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:57.027057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:57.027122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:57.027184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027261 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027284 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027294 2576 projected.go:196] Error preparing data for projected volume kube-api-access-74ggw for pod openshift-network-diagnostics/network-check-target-v7gx5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027284 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027309 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027352 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw podName:ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce nodeName:}" failed. No retries permitted until 2026-06-11 15:06:29.027336105 +0000 UTC m=+66.144828021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-74ggw" (UniqueName: "kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw") pod "network-check-target-v7gx5" (UID: "ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027368 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:06:29.027360843 +0000 UTC m=+66.144852737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:05:57.027541 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:57.027386 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret podName:f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32 nodeName:}" failed. No retries permitted until 2026-06-11 15:06:29.027376252 +0000 UTC m=+66.144868150 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret") pod "global-pull-secret-syncer-twzmn" (UID: "f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:05:58.199856 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.199635 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-38.ec2.internal" event="NodeReady" Jun 11 15:05:58.200278 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.199988 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 15:05:58.242598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.242323 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7vg56"] Jun 11 15:05:58.272651 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.272613 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9qkdn"] Jun 11 15:05:58.272842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.272755 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.274793 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.274774 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 15:05:58.274946 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.274782 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 15:05:58.274946 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.274782 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8hpwp\"" Jun 11 15:05:58.286627 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.286597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vg56"] Jun 11 15:05:58.288013 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.286638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9qkdn"] Jun 11 15:05:58.288013 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.286696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:58.288919 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.288900 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 15:05:58.289024 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.288959 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2zplz\"" Jun 11 15:05:58.289217 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.289194 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 15:05:58.289302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.289282 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 15:05:58.317147 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.317120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:05:58.317296 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.317120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:05:58.317296 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.317120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:05:58.319369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.319222 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:05:58.319369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.319250 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zmrv5\"" Jun 11 15:05:58.319369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.319255 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:05:58.319369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.319250 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4wl44\"" Jun 11 15:05:58.319369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.319272 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:05:58.319596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.319559 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:05:58.438207 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.438167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64607fb3-845e-4e7b-8698-7091faa7e8dc-cert\") pod \"ingress-canary-9qkdn\" (UID: \"64607fb3-845e-4e7b-8698-7091faa7e8dc\") " pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:58.438377 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.438234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-config-volume\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.438377 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.438286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlhz7\" (UniqueName: \"kubernetes.io/projected/64607fb3-845e-4e7b-8698-7091faa7e8dc-kube-api-access-dlhz7\") pod \"ingress-canary-9qkdn\" (UID: \"64607fb3-845e-4e7b-8698-7091faa7e8dc\") " pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:58.438377 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.438350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-tmp-dir\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.438518 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.438405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.438518 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.438452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whlbd\" (UniqueName: \"kubernetes.io/projected/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-kube-api-access-whlbd\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.539726 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.539694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-config-volume\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.539916 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.539748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlhz7\" (UniqueName: \"kubernetes.io/projected/64607fb3-845e-4e7b-8698-7091faa7e8dc-kube-api-access-dlhz7\") pod \"ingress-canary-9qkdn\" (UID: \"64607fb3-845e-4e7b-8698-7091faa7e8dc\") " pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:58.539916 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.539857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-tmp-dir\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.540058 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.539919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.540058 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.539962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whlbd\" (UniqueName: \"kubernetes.io/projected/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-kube-api-access-whlbd\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.540058 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.540010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64607fb3-845e-4e7b-8698-7091faa7e8dc-cert\") pod \"ingress-canary-9qkdn\" (UID: \"64607fb3-845e-4e7b-8698-7091faa7e8dc\") " pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:58.540229 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:58.540081 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:05:58.540229 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:58.540149 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls podName:98c5ab4c-7d81-4f98-bb75-0b3008f7939e nodeName:}" failed. No retries permitted until 2026-06-11 15:05:59.040128831 +0000 UTC m=+36.157620727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls") pod "dns-default-7vg56" (UID: "98c5ab4c-7d81-4f98-bb75-0b3008f7939e") : secret "dns-default-metrics-tls" not found Jun 11 15:05:58.540467 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.540446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-config-volume\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.540467 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.540463 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-tmp-dir\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.545021 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.545000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64607fb3-845e-4e7b-8698-7091faa7e8dc-cert\") pod \"ingress-canary-9qkdn\" (UID: \"64607fb3-845e-4e7b-8698-7091faa7e8dc\") " pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:58.548643 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.548623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whlbd\" (UniqueName: \"kubernetes.io/projected/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-kube-api-access-whlbd\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:58.549099 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.549077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlhz7\" (UniqueName: \"kubernetes.io/projected/64607fb3-845e-4e7b-8698-7091faa7e8dc-kube-api-access-dlhz7\") pod \"ingress-canary-9qkdn\" (UID: \"64607fb3-845e-4e7b-8698-7091faa7e8dc\") " pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:58.596905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:58.596867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9qkdn" Jun 11 15:05:59.043166 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:59.043132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:05:59.043324 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:59.043254 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:05:59.043369 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:05:59.043347 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls podName:98c5ab4c-7d81-4f98-bb75-0b3008f7939e nodeName:}" failed. No retries permitted until 2026-06-11 15:06:00.043331772 +0000 UTC m=+37.160823666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls") pod "dns-default-7vg56" (UID: "98c5ab4c-7d81-4f98-bb75-0b3008f7939e") : secret "dns-default-metrics-tls" not found Jun 11 15:05:59.587033 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:05:59.586996 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9qkdn"] Jun 11 15:05:59.591939 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:05:59.591739 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64607fb3_845e_4e7b_8698_7091faa7e8dc.slice/crio-bebc5d616b4a791a41739be5075fc7e2b76f35f49155090e163ade06e406059d WatchSource:0}: Error finding container bebc5d616b4a791a41739be5075fc7e2b76f35f49155090e163ade06e406059d: Status 404 returned error can't find the container with id bebc5d616b4a791a41739be5075fc7e2b76f35f49155090e163ade06e406059d Jun 11 15:06:00.052582 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:00.052523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:06:00.052738 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:00.052709 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:06:00.052811 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:00.052787 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls podName:98c5ab4c-7d81-4f98-bb75-0b3008f7939e nodeName:}" failed. No retries permitted until 2026-06-11 15:06:02.052762738 +0000 UTC m=+39.170254634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls") pod "dns-default-7vg56" (UID: "98c5ab4c-7d81-4f98-bb75-0b3008f7939e") : secret "dns-default-metrics-tls" not found Jun 11 15:06:00.481378 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:00.481283 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5a061b-0416-4ce6-8594-9ac9f0a789af" containerID="0a2950b27906dca22c28bbdb2b6f2b15e90ebb8062d55394d697dea57dbe2777" exitCode=0 Jun 11 15:06:00.481535 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:00.481373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerDied","Data":"0a2950b27906dca22c28bbdb2b6f2b15e90ebb8062d55394d697dea57dbe2777"} Jun 11 15:06:00.483006 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:00.482982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9qkdn" event={"ID":"64607fb3-845e-4e7b-8698-7091faa7e8dc","Type":"ContainerStarted","Data":"bebc5d616b4a791a41739be5075fc7e2b76f35f49155090e163ade06e406059d"} Jun 11 15:06:01.488311 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:01.488242 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5a061b-0416-4ce6-8594-9ac9f0a789af" containerID="6f1a21e105c584d9d4d7872d59d8a2001a782adde60ab6d68111687f88bffec8" exitCode=0 Jun 11 15:06:01.488966 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:01.488322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerDied","Data":"6f1a21e105c584d9d4d7872d59d8a2001a782adde60ab6d68111687f88bffec8"} Jun 11 15:06:01.489743 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:01.489720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9qkdn" event={"ID":"64607fb3-845e-4e7b-8698-7091faa7e8dc","Type":"ContainerStarted","Data":"b6bb219a56c6dc15f560682139ac64caa795d6c756f24346a82d3bc1c9dd6fe5"} Jun 11 15:06:01.524224 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:01.524173 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9qkdn" podStartSLOduration=1.9100365190000002 podStartE2EDuration="3.524154864s" totalImagesPullingTime="1.614118345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:01.52306518 +0000 UTC m=+38.640557098" watchObservedRunningTime="2026-06-11 15:06:01.524154864 +0000 UTC m=+38.641646780" Jun 11 15:06:02.068222 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:02.068194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:06:02.068349 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:02.068300 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:06:02.068386 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:02.068350 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls podName:98c5ab4c-7d81-4f98-bb75-0b3008f7939e nodeName:}" failed. No retries permitted until 2026-06-11 15:06:06.068337447 +0000 UTC m=+43.185829342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls") pod "dns-default-7vg56" (UID: "98c5ab4c-7d81-4f98-bb75-0b3008f7939e") : secret "dns-default-metrics-tls" not found Jun 11 15:06:02.495336 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:02.495293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" event={"ID":"7f5a061b-0416-4ce6-8594-9ac9f0a789af","Type":"ContainerStarted","Data":"2182466598aa2709914b735cb69033450b4ae721b9641a9a467c1cbc5378dd1b"} Jun 11 15:06:02.517484 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:02.517435 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d4lzb" podStartSLOduration=9.956280716 podStartE2EDuration="39.517419819s" totalImagesPullingTime="29.561139103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:02.516332686 +0000 UTC m=+39.633824602" watchObservedRunningTime="2026-06-11 15:06:02.517419819 +0000 UTC m=+39.634911735" Jun 11 15:06:06.096743 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:06.096706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:06:06.097224 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:06.096882 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:06:06.097224 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:06.096958 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls podName:98c5ab4c-7d81-4f98-bb75-0b3008f7939e nodeName:}" failed. No retries permitted until 2026-06-11 15:06:14.096939093 +0000 UTC m=+51.214431001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls") pod "dns-default-7vg56" (UID: "98c5ab4c-7d81-4f98-bb75-0b3008f7939e") : secret "dns-default-metrics-tls" not found Jun 11 15:06:14.151848 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:14.151791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:06:14.152396 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:14.151950 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:06:14.152396 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:14.152022 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls podName:98c5ab4c-7d81-4f98-bb75-0b3008f7939e nodeName:}" failed. No retries permitted until 2026-06-11 15:06:30.152006317 +0000 UTC m=+67.269498215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls") pod "dns-default-7vg56" (UID: "98c5ab4c-7d81-4f98-bb75-0b3008f7939e") : secret "dns-default-metrics-tls" not found Jun 11 15:06:19.691854 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.691795 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59"] Jun 11 15:06:19.738171 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.738138 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6847869686-72s7x"] Jun 11 15:06:19.738337 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.738262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" Jun 11 15:06:19.740701 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.740678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:06:19.740851 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.740678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 15:06:19.740851 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.740680 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zkggk\"" Jun 11 15:06:19.750918 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.750896 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59"] Jun 11 15:06:19.751054 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.751024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.751054 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.751053 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6847869686-72s7x"] Jun 11 15:06:19.752887 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.752866 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 15:06:19.753007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.752902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rlqv\"" Jun 11 15:06:19.753007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.752932 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 15:06:19.753150 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.753137 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 15:06:19.758555 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.758534 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.790992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qct9p\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-kube-api-access-qct9p\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-image-registry-private-configuration\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b35e69-52bb-44c9-b51c-fbe63520df6f-ca-trust-extracted\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbhv\" (UniqueName: \"kubernetes.io/projected/2f54e9a5-e116-4f98-9096-73592e8a08e8-kube-api-access-wzbhv\") pod \"volume-data-source-validator-78dd696465-tqp59\" (UID: \"2f54e9a5-e116-4f98-9096-73592e8a08e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-certificates\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-trusted-ca\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-bound-sa-token\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-installation-pull-secrets\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.792905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.791353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.795097 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.795074 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-v9gc6"] Jun 11 15:06:19.818958 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.818935 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt"] Jun 11 15:06:19.819080 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.819049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.821431 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.821407 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 15:06:19.821541 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.821512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 15:06:19.821541 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.821527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 15:06:19.821650 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.821541 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bn8k8\"" Jun 11 15:06:19.821650 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.821542 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 15:06:19.827248 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.827230 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 15:06:19.843674 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.843652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-v9gc6"] Jun 11 15:06:19.843674 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.843678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt"] Jun 11 15:06:19.843794 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.843741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.848134 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.848116 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 15:06:19.848528 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.848515 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 15:06:19.848606 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.848570 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 15:06:19.848674 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.848652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:06:19.848842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.848828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-82dz7\"" Jun 11 15:06:19.891970 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.891941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7237fe16-998f-480c-ad41-0708dc5e5bba-tmp\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.892099 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.891985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74s6n\" (UniqueName: \"kubernetes.io/projected/7237fe16-998f-480c-ad41-0708dc5e5bba-kube-api-access-74s6n\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.892099 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-image-registry-private-configuration\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892099 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b35e69-52bb-44c9-b51c-fbe63520df6f-ca-trust-extracted\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892218 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbhv\" (UniqueName: \"kubernetes.io/projected/2f54e9a5-e116-4f98-9096-73592e8a08e8-kube-api-access-wzbhv\") pod \"volume-data-source-validator-78dd696465-tqp59\" (UID: \"2f54e9a5-e116-4f98-9096-73592e8a08e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" Jun 11 15:06:19.892218 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-certificates\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892218 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-trusted-ca\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892218 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-bound-sa-token\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892390 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7237fe16-998f-480c-ad41-0708dc5e5bba-trusted-ca-bundle\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.892447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7237fe16-998f-480c-ad41-0708dc5e5bba-serving-cert\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.892447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-installation-pull-secrets\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b8ddf5b-a7c7-488d-a098-a648061085f3-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.892545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b8ddf5b-a7c7-488d-a098-a648061085f3-config\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.892545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khl5z\" (UniqueName: \"kubernetes.io/projected/8b8ddf5b-a7c7-488d-a098-a648061085f3-kube-api-access-khl5z\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.892545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7237fe16-998f-480c-ad41-0708dc5e5bba-service-ca-bundle\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.892744 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892744 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7237fe16-998f-480c-ad41-0708dc5e5bba-snapshots\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.892744 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b35e69-52bb-44c9-b51c-fbe63520df6f-ca-trust-extracted\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.892744 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:19.892708 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:06:19.892744 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:19.892723 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6847869686-72s7x: secret "image-registry-tls" not found Jun 11 15:06:19.893014 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-certificates\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.893014 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.892718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qct9p\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-kube-api-access-qct9p\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.893014 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:19.892795 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls podName:f2b35e69-52bb-44c9-b51c-fbe63520df6f nodeName:}" failed. No retries permitted until 2026-06-11 15:06:20.392775988 +0000 UTC m=+57.510267883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls") pod "image-registry-6847869686-72s7x" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f") : secret "image-registry-tls" not found Jun 11 15:06:19.893200 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.893182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-trusted-ca\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.895891 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.895864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-installation-pull-secrets\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.895989 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.895877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-image-registry-private-configuration\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.900362 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.900336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-bound-sa-token\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.901031 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.901011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbhv\" (UniqueName: \"kubernetes.io/projected/2f54e9a5-e116-4f98-9096-73592e8a08e8-kube-api-access-wzbhv\") pod \"volume-data-source-validator-78dd696465-tqp59\" (UID: \"2f54e9a5-e116-4f98-9096-73592e8a08e8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" Jun 11 15:06:19.901273 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.901256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qct9p\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-kube-api-access-qct9p\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:19.993827 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7237fe16-998f-480c-ad41-0708dc5e5bba-service-ca-bundle\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.993827 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7237fe16-998f-480c-ad41-0708dc5e5bba-snapshots\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.994038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7237fe16-998f-480c-ad41-0708dc5e5bba-tmp\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.994038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74s6n\" (UniqueName: \"kubernetes.io/projected/7237fe16-998f-480c-ad41-0708dc5e5bba-kube-api-access-74s6n\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.994038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7237fe16-998f-480c-ad41-0708dc5e5bba-trusted-ca-bundle\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.994038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7237fe16-998f-480c-ad41-0708dc5e5bba-serving-cert\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.994038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b8ddf5b-a7c7-488d-a098-a648061085f3-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.994038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b8ddf5b-a7c7-488d-a098-a648061085f3-config\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.994038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.993990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khl5z\" (UniqueName: \"kubernetes.io/projected/8b8ddf5b-a7c7-488d-a098-a648061085f3-kube-api-access-khl5z\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.994473 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.994445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7237fe16-998f-480c-ad41-0708dc5e5bba-service-ca-bundle\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.994681 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.994660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7237fe16-998f-480c-ad41-0708dc5e5bba-tmp\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.994747 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.994728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b8ddf5b-a7c7-488d-a098-a648061085f3-config\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.994867 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.994848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7237fe16-998f-480c-ad41-0708dc5e5bba-trusted-ca-bundle\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.995297 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.995275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7237fe16-998f-480c-ad41-0708dc5e5bba-snapshots\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:19.996186 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.996160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b8ddf5b-a7c7-488d-a098-a648061085f3-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:19.996789 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:19.996773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7237fe16-998f-480c-ad41-0708dc5e5bba-serving-cert\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:20.001927 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.001903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khl5z\" (UniqueName: \"kubernetes.io/projected/8b8ddf5b-a7c7-488d-a098-a648061085f3-kube-api-access-khl5z\") pod \"service-ca-operator-6bc5ff68f5-9mxvt\" (UID: \"8b8ddf5b-a7c7-488d-a098-a648061085f3\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:20.001927 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.001923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74s6n\" (UniqueName: \"kubernetes.io/projected/7237fe16-998f-480c-ad41-0708dc5e5bba-kube-api-access-74s6n\") pod \"insights-operator-896549976-v9gc6\" (UID: \"7237fe16-998f-480c-ad41-0708dc5e5bba\") " pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:20.046768 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.046746 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" Jun 11 15:06:20.128466 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.128436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-v9gc6" Jun 11 15:06:20.152259 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.152226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" Jun 11 15:06:20.202256 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.201959 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59"] Jun 11 15:06:20.208036 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:20.207992 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f54e9a5_e116_4f98_9096_73592e8a08e8.slice/crio-f4fb16531ddd6f03a23f6c145be38a893106f3792108b898e067a4a866c3e539 WatchSource:0}: Error finding container f4fb16531ddd6f03a23f6c145be38a893106f3792108b898e067a4a866c3e539: Status 404 returned error can't find the container with id f4fb16531ddd6f03a23f6c145be38a893106f3792108b898e067a4a866c3e539 Jun 11 15:06:20.305382 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.305348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-v9gc6"] Jun 11 15:06:20.309261 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:20.309235 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7237fe16_998f_480c_ad41_0708dc5e5bba.slice/crio-3950b9c38f4cb68d050dbcc9004392632f800f619bfed04a89a7f1fa8a754b97 WatchSource:0}: Error finding container 3950b9c38f4cb68d050dbcc9004392632f800f619bfed04a89a7f1fa8a754b97: Status 404 returned error can't find the container with id 3950b9c38f4cb68d050dbcc9004392632f800f619bfed04a89a7f1fa8a754b97 Jun 11 15:06:20.318022 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.318001 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt"] Jun 11 15:06:20.320931 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:20.320910 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8ddf5b_a7c7_488d_a098_a648061085f3.slice/crio-1e9c155f2e869f0c1f3d2d54c26337e10da44785a12ac966a6456048ffae7332 WatchSource:0}: Error finding container 1e9c155f2e869f0c1f3d2d54c26337e10da44785a12ac966a6456048ffae7332: Status 404 returned error can't find the container with id 1e9c155f2e869f0c1f3d2d54c26337e10da44785a12ac966a6456048ffae7332 Jun 11 15:06:20.396996 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.396967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:20.397165 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:20.397145 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:06:20.397222 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:20.397168 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6847869686-72s7x: secret "image-registry-tls" not found Jun 11 15:06:20.397278 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:20.397232 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls podName:f2b35e69-52bb-44c9-b51c-fbe63520df6f nodeName:}" failed. No retries permitted until 2026-06-11 15:06:21.397209052 +0000 UTC m=+58.514700966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls") pod "image-registry-6847869686-72s7x" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f") : secret "image-registry-tls" not found Jun 11 15:06:20.536329 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.536295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v9gc6" event={"ID":"7237fe16-998f-480c-ad41-0708dc5e5bba","Type":"ContainerStarted","Data":"3950b9c38f4cb68d050dbcc9004392632f800f619bfed04a89a7f1fa8a754b97"} Jun 11 15:06:20.537419 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.537396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" event={"ID":"8b8ddf5b-a7c7-488d-a098-a648061085f3","Type":"ContainerStarted","Data":"1e9c155f2e869f0c1f3d2d54c26337e10da44785a12ac966a6456048ffae7332"} Jun 11 15:06:20.538372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:20.538352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" event={"ID":"2f54e9a5-e116-4f98-9096-73592e8a08e8","Type":"ContainerStarted","Data":"f4fb16531ddd6f03a23f6c145be38a893106f3792108b898e067a4a866c3e539"} Jun 11 15:06:21.406423 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:21.406382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:21.406917 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:21.406650 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:06:21.406917 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:21.406668 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6847869686-72s7x: secret "image-registry-tls" not found Jun 11 15:06:21.406917 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:21.406727 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls podName:f2b35e69-52bb-44c9-b51c-fbe63520df6f nodeName:}" failed. No retries permitted until 2026-06-11 15:06:23.406707545 +0000 UTC m=+60.524199438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls") pod "image-registry-6847869686-72s7x" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f") : secret "image-registry-tls" not found Jun 11 15:06:23.421784 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:23.421760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:23.422094 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:23.421923 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:06:23.422094 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:23.421943 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6847869686-72s7x: secret "image-registry-tls" not found Jun 11 15:06:23.422094 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:23.422003 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls podName:f2b35e69-52bb-44c9-b51c-fbe63520df6f nodeName:}" failed. No retries permitted until 2026-06-11 15:06:27.421982312 +0000 UTC m=+64.539474223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls") pod "image-registry-6847869686-72s7x" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f") : secret "image-registry-tls" not found Jun 11 15:06:23.548234 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:23.548207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" event={"ID":"8b8ddf5b-a7c7-488d-a098-a648061085f3","Type":"ContainerStarted","Data":"506286220eb5ee191cfdc41ee0c32dc7070fd6f210c6b81ce4f5e4bf8aa916a8"} Jun 11 15:06:23.550261 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:23.550235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" event={"ID":"2f54e9a5-e116-4f98-9096-73592e8a08e8","Type":"ContainerStarted","Data":"3246868b77cfa95a21b3334d09c4c08d52d77bc85e2f6de30d9a3d42d27fb3e2"} Jun 11 15:06:23.570323 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:23.570271 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-tqp59" podStartSLOduration=1.3831484729999999 podStartE2EDuration="4.570254507s" totalImagesPullingTime="3.187106034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:23.568646477 +0000 UTC m=+60.686138394" watchObservedRunningTime="2026-06-11 15:06:23.570254507 +0000 UTC m=+60.687746423" Jun 11 15:06:24.483795 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:24.483765 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fst2x" Jun 11 15:06:24.556552 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:24.556493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v9gc6" event={"ID":"7237fe16-998f-480c-ad41-0708dc5e5bba","Type":"ContainerStarted","Data":"6d736290cf3462ddbdd4daeba39840d229db6dab56645639bd97f10b5e3fdf8a"} Jun 11 15:06:24.580071 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:24.580020 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-v9gc6" podStartSLOduration=2.466455143 podStartE2EDuration="5.579999954s" totalImagesPullingTime="3.113544811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:24.579072304 +0000 UTC m=+61.696564214" watchObservedRunningTime="2026-06-11 15:06:24.579999954 +0000 UTC m=+61.697491870" Jun 11 15:06:24.606428 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:24.606369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" podStartSLOduration=2.509896327 podStartE2EDuration="5.606345589s" totalImagesPullingTime="3.096449262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:24.605832458 +0000 UTC m=+61.723324382" watchObservedRunningTime="2026-06-11 15:06:24.606345589 +0000 UTC m=+61.723837505" Jun 11 15:06:25.680942 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.680913 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-ss484"] Jun 11 15:06:25.698183 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.698154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-ss484"] Jun 11 15:06:25.698344 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.698271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" Jun 11 15:06:25.700545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.700526 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-m75qr\"" Jun 11 15:06:25.739578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.739545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgth\" (UniqueName: \"kubernetes.io/projected/0213817b-2649-4825-ae7b-18b6f2c87c1b-kube-api-access-2sgth\") pod \"network-check-source-dbd9cf844-ss484\" (UID: \"0213817b-2649-4825-ae7b-18b6f2c87c1b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" Jun 11 15:06:25.840502 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.840458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgth\" (UniqueName: \"kubernetes.io/projected/0213817b-2649-4825-ae7b-18b6f2c87c1b-kube-api-access-2sgth\") pod \"network-check-source-dbd9cf844-ss484\" (UID: \"0213817b-2649-4825-ae7b-18b6f2c87c1b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" Jun 11 15:06:25.848245 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.848223 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:06:25.858787 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.858760 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:06:25.869978 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:25.869952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgth\" (UniqueName: \"kubernetes.io/projected/0213817b-2649-4825-ae7b-18b6f2c87c1b-kube-api-access-2sgth\") pod \"network-check-source-dbd9cf844-ss484\" (UID: \"0213817b-2649-4825-ae7b-18b6f2c87c1b\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" Jun 11 15:06:26.006672 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:26.006588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" Jun 11 15:06:26.155453 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:26.155421 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-ss484"] Jun 11 15:06:26.159824 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:26.159776 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0213817b_2649_4825_ae7b_18b6f2c87c1b.slice/crio-1d381e67e99ddf0a7c1926b071868bc2c1594c8448cb1dc08f415eb378967162 WatchSource:0}: Error finding container 1d381e67e99ddf0a7c1926b071868bc2c1594c8448cb1dc08f415eb378967162: Status 404 returned error can't find the container with id 1d381e67e99ddf0a7c1926b071868bc2c1594c8448cb1dc08f415eb378967162 Jun 11 15:06:26.562288 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:26.562258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" event={"ID":"0213817b-2649-4825-ae7b-18b6f2c87c1b","Type":"ContainerStarted","Data":"1d381e67e99ddf0a7c1926b071868bc2c1594c8448cb1dc08f415eb378967162"} Jun 11 15:06:26.729063 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:26.729037 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z5sbv_5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75/dns-node-resolver/0.log" Jun 11 15:06:27.074882 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.074850 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-qqckb"] Jun 11 15:06:27.077250 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.077228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.080692 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.080673 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 15:06:27.080819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.080686 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m8nb9\"" Jun 11 15:06:27.080819 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.080686 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 15:06:27.081174 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.081155 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 15:06:27.081242 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.081175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 15:06:27.094902 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.094880 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-qqckb"] Jun 11 15:06:27.150211 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.150183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b776e2d-e1c4-4abb-9412-e30a510d8278-signing-cabundle\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.150400 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.150219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft774\" (UniqueName: \"kubernetes.io/projected/9b776e2d-e1c4-4abb-9412-e30a510d8278-kube-api-access-ft774\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.150400 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.150246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b776e2d-e1c4-4abb-9412-e30a510d8278-signing-key\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.251833 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.251781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b776e2d-e1c4-4abb-9412-e30a510d8278-signing-cabundle\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.252016 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.251849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft774\" (UniqueName: \"kubernetes.io/projected/9b776e2d-e1c4-4abb-9412-e30a510d8278-kube-api-access-ft774\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.252016 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.251882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b776e2d-e1c4-4abb-9412-e30a510d8278-signing-key\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.252507 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.252482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9b776e2d-e1c4-4abb-9412-e30a510d8278-signing-cabundle\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.254839 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.254795 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9b776e2d-e1c4-4abb-9412-e30a510d8278-signing-key\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.261586 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.261542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft774\" (UniqueName: \"kubernetes.io/projected/9b776e2d-e1c4-4abb-9412-e30a510d8278-kube-api-access-ft774\") pod \"service-ca-7d74d578b8-qqckb\" (UID: \"9b776e2d-e1c4-4abb-9412-e30a510d8278\") " pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.329750 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.329675 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gspjf_fd6407d6-55b8-412b-a1ac-bd64d6c88938/node-ca/0.log" Jun 11 15:06:27.388379 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.388345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" Jun 11 15:06:27.454053 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.454019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:27.454189 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:27.454173 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:06:27.454231 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:27.454195 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6847869686-72s7x: secret "image-registry-tls" not found Jun 11 15:06:27.454277 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:27.454265 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls podName:f2b35e69-52bb-44c9-b51c-fbe63520df6f nodeName:}" failed. No retries permitted until 2026-06-11 15:06:35.454244257 +0000 UTC m=+72.571736170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls") pod "image-registry-6847869686-72s7x" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f") : secret "image-registry-tls" not found Jun 11 15:06:27.522046 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.522013 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-qqckb"] Jun 11 15:06:27.527631 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:27.527596 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b776e2d_e1c4_4abb_9412_e30a510d8278.slice/crio-683efbef6a2389c017b1e41276e753659de21b264a6fc2e722df68df215b4508 WatchSource:0}: Error finding container 683efbef6a2389c017b1e41276e753659de21b264a6fc2e722df68df215b4508: Status 404 returned error can't find the container with id 683efbef6a2389c017b1e41276e753659de21b264a6fc2e722df68df215b4508 Jun 11 15:06:27.565872 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:27.565843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" event={"ID":"9b776e2d-e1c4-4abb-9412-e30a510d8278","Type":"ContainerStarted","Data":"683efbef6a2389c017b1e41276e753659de21b264a6fc2e722df68df215b4508"} Jun 11 15:06:28.129748 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:28.129724 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9qkdn_64607fb3-845e-4e7b-8698-7091faa7e8dc/serve-healthcheck-canary/0.log" Jun 11 15:06:28.570465 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:28.570424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" event={"ID":"9b776e2d-e1c4-4abb-9412-e30a510d8278","Type":"ContainerStarted","Data":"adc6c249d60005045bd149a2bf8ddcf1520d635caf9cdd12b1a20538e6bc3d7e"} Jun 11 15:06:28.595301 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:28.594727 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-qqckb" podStartSLOduration=1.594704449 podStartE2EDuration="1.594704449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:28.59333349 +0000 UTC m=+65.710825419" watchObservedRunningTime="2026-06-11 15:06:28.594704449 +0000 UTC m=+65.712196366" Jun 11 15:06:29.069835 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.069481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:06:29.069835 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.069547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:06:29.069835 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.069580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:06:29.072600 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.072576 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:06:29.072924 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.072892 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:06:29.073325 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.073107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74ggw\" (UniqueName: \"kubernetes.io/projected/ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce-kube-api-access-74ggw\") pod \"network-check-target-v7gx5\" (UID: \"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce\") " pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:06:29.081852 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:29.081826 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:06:29.081979 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:29.081905 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs podName:170a715a-3c6b-4fd8-ac68-5607f70b88ce nodeName:}" failed. No retries permitted until 2026-06-11 15:07:33.081883179 +0000 UTC m=+130.199375093 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs") pod "network-metrics-daemon-m5v9x" (UID: "170a715a-3c6b-4fd8-ac68-5607f70b88ce") : secret "metrics-daemon-secret" not found Jun 11 15:06:29.096267 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.096189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32-original-pull-secret\") pod \"global-pull-secret-syncer-twzmn\" (UID: \"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32\") " pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:06:29.238107 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.237885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4wl44\"" Jun 11 15:06:29.241841 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.241754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-twzmn" Jun 11 15:06:29.248000 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.245786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:06:29.934082 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.934052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-twzmn"] Jun 11 15:06:29.937928 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:29.937901 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c1ea86_0ac1_4516_bdaf_28a71a1c3f32.slice/crio-9c3649941713a9e28bcff27a1492e6cca8fe8c9db3e56717c94d2cb1108e196b WatchSource:0}: Error finding container 9c3649941713a9e28bcff27a1492e6cca8fe8c9db3e56717c94d2cb1108e196b: Status 404 returned error can't find the container with id 9c3649941713a9e28bcff27a1492e6cca8fe8c9db3e56717c94d2cb1108e196b Jun 11 15:06:29.952715 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:29.952687 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v7gx5"] Jun 11 15:06:29.956433 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:29.956391 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3fe478_8a6f_4bf2_9084_1a56b6dd9fce.slice/crio-f1112d399af56a6a74fc880195bda28071934d3251dc96d5a6ec9b485a6dcec4 WatchSource:0}: Error finding container f1112d399af56a6a74fc880195bda28071934d3251dc96d5a6ec9b485a6dcec4: Status 404 returned error can't find the container with id f1112d399af56a6a74fc880195bda28071934d3251dc96d5a6ec9b485a6dcec4 Jun 11 15:06:30.178434 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.178336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:06:30.178616 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:30.178492 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:06:30.178616 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:30.178551 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls podName:98c5ab4c-7d81-4f98-bb75-0b3008f7939e nodeName:}" failed. No retries permitted until 2026-06-11 15:07:02.178535584 +0000 UTC m=+99.296027478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls") pod "dns-default-7vg56" (UID: "98c5ab4c-7d81-4f98-bb75-0b3008f7939e") : secret "dns-default-metrics-tls" not found Jun 11 15:06:30.579559 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.579120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v7gx5" event={"ID":"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce","Type":"ContainerStarted","Data":"78a14a32a073e279db3446711a8232311ca96e0a08a0cc92286bdf00c16e5573"} Jun 11 15:06:30.579559 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.579180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v7gx5" event={"ID":"ce3fe478-8a6f-4bf2-9084-1a56b6dd9fce","Type":"ContainerStarted","Data":"f1112d399af56a6a74fc880195bda28071934d3251dc96d5a6ec9b485a6dcec4"} Jun 11 15:06:30.579559 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.579223 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:06:30.582322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.582287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" event={"ID":"0213817b-2649-4825-ae7b-18b6f2c87c1b","Type":"ContainerStarted","Data":"ccc604896ae1d1b4ab0438edced5b8505d53ce806e94142aa4e2175c4e05223b"} Jun 11 15:06:30.584088 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.584060 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-twzmn" event={"ID":"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32","Type":"ContainerStarted","Data":"9c3649941713a9e28bcff27a1492e6cca8fe8c9db3e56717c94d2cb1108e196b"} Jun 11 15:06:30.596735 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.596670 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v7gx5" podStartSLOduration=67.596646475 podStartE2EDuration="1m7.596646475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:30.594982876 +0000 UTC m=+67.712474792" watchObservedRunningTime="2026-06-11 15:06:30.596646475 +0000 UTC m=+67.714138393" Jun 11 15:06:30.610839 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:30.610467 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-ss484" podStartSLOduration=1.9280488550000001 podStartE2EDuration="5.610450497s" totalImagesPullingTime="3.682401642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:30.609731015 +0000 UTC m=+67.727222931" watchObservedRunningTime="2026-06-11 15:06:30.610450497 +0000 UTC m=+67.727942412" Jun 11 15:06:34.608040 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:34.607895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-twzmn" event={"ID":"f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32","Type":"ContainerStarted","Data":"d54ab87fa908822c0ae6ff0acccf49e5a90f34c716b109c305673a45f9e6ff0b"} Jun 11 15:06:34.629886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:34.629834 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-twzmn" podStartSLOduration=67.826889993 podStartE2EDuration="1m11.629818636s" totalImagesPullingTime="3.802928643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:34.628703408 +0000 UTC m=+71.746195325" watchObservedRunningTime="2026-06-11 15:06:34.629818636 +0000 UTC m=+71.747310543" Jun 11 15:06:35.527716 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:35.527682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:35.530131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:35.530111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"image-registry-6847869686-72s7x\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:35.661405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:35.661377 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rlqv\"" Jun 11 15:06:35.669940 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:35.669918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:35.804267 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:35.804190 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6847869686-72s7x"] Jun 11 15:06:35.807828 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:35.807776 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b35e69_52bb_44c9_b51c_fbe63520df6f.slice/crio-19ca75dfa50ab5a36cbef7fde663f4f96f7c415758a76c52b042471f658933a9 WatchSource:0}: Error finding container 19ca75dfa50ab5a36cbef7fde663f4f96f7c415758a76c52b042471f658933a9: Status 404 returned error can't find the container with id 19ca75dfa50ab5a36cbef7fde663f4f96f7c415758a76c52b042471f658933a9 Jun 11 15:06:36.616312 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:36.616275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847869686-72s7x" event={"ID":"f2b35e69-52bb-44c9-b51c-fbe63520df6f","Type":"ContainerStarted","Data":"1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51"} Jun 11 15:06:36.616539 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:36.616332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847869686-72s7x" event={"ID":"f2b35e69-52bb-44c9-b51c-fbe63520df6f","Type":"ContainerStarted","Data":"19ca75dfa50ab5a36cbef7fde663f4f96f7c415758a76c52b042471f658933a9"} Jun 11 15:06:36.616539 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:36.616430 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:06:49.673195 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.673145 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6847869686-72s7x" podStartSLOduration=30.673129376 podStartE2EDuration="30.673129376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:36.636385739 +0000 UTC m=+73.753877654" watchObservedRunningTime="2026-06-11 15:06:49.673129376 +0000 UTC m=+86.790621270" Jun 11 15:06:49.673674 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.673623 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zvtcz"] Jun 11 15:06:49.678267 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.678245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.682888 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.682869 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 15:06:49.684546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.684526 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nxtwf\"" Jun 11 15:06:49.684546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.684538 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 15:06:49.705307 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.705277 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6847869686-72s7x"] Jun 11 15:06:49.725929 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.725907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvtcz"] Jun 11 15:06:49.754817 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.754785 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-rkt8q"] Jun 11 15:06:49.756783 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.756768 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-rkt8q" Jun 11 15:06:49.758628 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.758562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wvqs9\"" Jun 11 15:06:49.758740 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.758721 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 15:06:49.758785 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.758762 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 15:06:49.770344 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.770320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-rkt8q"] Jun 11 15:06:49.836950 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.836921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865e4df2-1b19-424d-ab92-0df8813a9c9a-data-volume\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.837091 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.836956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865e4df2-1b19-424d-ab92-0df8813a9c9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.837091 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.836993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865e4df2-1b19-424d-ab92-0df8813a9c9a-crio-socket\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.837091 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.837045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmq5t\" (UniqueName: \"kubernetes.io/projected/865e4df2-1b19-424d-ab92-0df8813a9c9a-kube-api-access-pmq5t\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.837091 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.837087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqbqm\" (UniqueName: \"kubernetes.io/projected/b0643eb0-5d90-429a-9226-10a6a9bb41fa-kube-api-access-fqbqm\") pod \"downloads-6657875f97-rkt8q\" (UID: \"b0643eb0-5d90-429a-9226-10a6a9bb41fa\") " pod="openshift-console/downloads-6657875f97-rkt8q" Jun 11 15:06:49.837224 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.837114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865e4df2-1b19-424d-ab92-0df8813a9c9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.937900 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.937829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmq5t\" (UniqueName: \"kubernetes.io/projected/865e4df2-1b19-424d-ab92-0df8813a9c9a-kube-api-access-pmq5t\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.937900 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.937877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqbqm\" (UniqueName: \"kubernetes.io/projected/b0643eb0-5d90-429a-9226-10a6a9bb41fa-kube-api-access-fqbqm\") pod \"downloads-6657875f97-rkt8q\" (UID: \"b0643eb0-5d90-429a-9226-10a6a9bb41fa\") " pod="openshift-console/downloads-6657875f97-rkt8q" Jun 11 15:06:49.938066 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.937908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865e4df2-1b19-424d-ab92-0df8813a9c9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.938066 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.937963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865e4df2-1b19-424d-ab92-0df8813a9c9a-data-volume\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.938066 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.937989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865e4df2-1b19-424d-ab92-0df8813a9c9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.938196 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.938131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865e4df2-1b19-424d-ab92-0df8813a9c9a-crio-socket\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.938252 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.938214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/865e4df2-1b19-424d-ab92-0df8813a9c9a-crio-socket\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.938349 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.938314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/865e4df2-1b19-424d-ab92-0df8813a9c9a-data-volume\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.938588 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.938573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/865e4df2-1b19-424d-ab92-0df8813a9c9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.940641 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.940623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/865e4df2-1b19-424d-ab92-0df8813a9c9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.948478 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.948453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqbqm\" (UniqueName: \"kubernetes.io/projected/b0643eb0-5d90-429a-9226-10a6a9bb41fa-kube-api-access-fqbqm\") pod \"downloads-6657875f97-rkt8q\" (UID: \"b0643eb0-5d90-429a-9226-10a6a9bb41fa\") " pod="openshift-console/downloads-6657875f97-rkt8q" Jun 11 15:06:49.949083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.949063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmq5t\" (UniqueName: \"kubernetes.io/projected/865e4df2-1b19-424d-ab92-0df8813a9c9a-kube-api-access-pmq5t\") pod \"insights-runtime-extractor-zvtcz\" (UID: \"865e4df2-1b19-424d-ab92-0df8813a9c9a\") " pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:49.986865 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:49.986840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvtcz" Jun 11 15:06:50.066194 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:50.066166 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-rkt8q" Jun 11 15:06:50.117616 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:50.117035 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvtcz"] Jun 11 15:06:50.121452 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:50.121412 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865e4df2_1b19_424d_ab92_0df8813a9c9a.slice/crio-513a26e6fc4c24d1e54ed682309b2565e20d9a19830456856ce9d70209439757 WatchSource:0}: Error finding container 513a26e6fc4c24d1e54ed682309b2565e20d9a19830456856ce9d70209439757: Status 404 returned error can't find the container with id 513a26e6fc4c24d1e54ed682309b2565e20d9a19830456856ce9d70209439757 Jun 11 15:06:50.195120 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:50.195050 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-rkt8q"] Jun 11 15:06:50.198515 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:50.198484 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0643eb0_5d90_429a_9226_10a6a9bb41fa.slice/crio-8ed340f524f4c577d21555a1e93c1392c9897d3ae60399eefa22c247ed8554ca WatchSource:0}: Error finding container 8ed340f524f4c577d21555a1e93c1392c9897d3ae60399eefa22c247ed8554ca: Status 404 returned error can't find the container with id 8ed340f524f4c577d21555a1e93c1392c9897d3ae60399eefa22c247ed8554ca Jun 11 15:06:50.660153 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:50.660101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvtcz" event={"ID":"865e4df2-1b19-424d-ab92-0df8813a9c9a","Type":"ContainerStarted","Data":"ea871f41fe2372c66e1f2265c086b6bc22a41d20ac52e4267b590774f667d337"} Jun 11 15:06:50.660329 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:50.660190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvtcz" event={"ID":"865e4df2-1b19-424d-ab92-0df8813a9c9a","Type":"ContainerStarted","Data":"513a26e6fc4c24d1e54ed682309b2565e20d9a19830456856ce9d70209439757"} Jun 11 15:06:50.661294 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:50.661266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-rkt8q" event={"ID":"b0643eb0-5d90-429a-9226-10a6a9bb41fa","Type":"ContainerStarted","Data":"8ed340f524f4c577d21555a1e93c1392c9897d3ae60399eefa22c247ed8554ca"} Jun 11 15:06:51.307342 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.307304 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6c4b7f45-gbbmf"] Jun 11 15:06:51.309623 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.309599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.312021 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.311673 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 15:06:51.312021 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.311677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 15:06:51.312481 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.312462 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 15:06:51.312589 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.312492 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2vkdz\"" Jun 11 15:06:51.312863 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.312698 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 15:06:51.312863 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.312788 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 15:06:51.323490 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.323438 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6c4b7f45-gbbmf"] Jun 11 15:06:51.449246 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.449207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-oauth-serving-cert\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.449444 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.449259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-config\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.449444 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.449291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phsrt\" (UniqueName: \"kubernetes.io/projected/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-kube-api-access-phsrt\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.449444 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.449373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-serving-cert\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.449444 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.449404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-oauth-config\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.449676 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.449449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-service-ca\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.550448 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.550316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-oauth-serving-cert\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.550448 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.550360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-config\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.550448 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.550378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phsrt\" (UniqueName: \"kubernetes.io/projected/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-kube-api-access-phsrt\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.550448 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.550402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-serving-cert\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.550448 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.550421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-oauth-config\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.550765 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.550461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-service-ca\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.551183 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.551143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-oauth-serving-cert\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.551316 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.551191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-service-ca\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.551435 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.551412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-config\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.553613 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.553591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-serving-cert\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.553944 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.553924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-oauth-config\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.558420 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.558373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phsrt\" (UniqueName: \"kubernetes.io/projected/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-kube-api-access-phsrt\") pod \"console-6b6c4b7f45-gbbmf\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.622516 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.622478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:06:51.671152 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.671074 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvtcz" event={"ID":"865e4df2-1b19-424d-ab92-0df8813a9c9a","Type":"ContainerStarted","Data":"0becca101d090ace10bc09d35e7a5d13c91e20afb2cac8a730cc34e71593f364"} Jun 11 15:06:51.781365 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:51.781331 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6c4b7f45-gbbmf"] Jun 11 15:06:51.785540 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:51.785508 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode256dc95_2f93_436b_bac4_b0c16aaf3ffa.slice/crio-72e7b73222009a5e4c2525450ef82f2168f704edf523a254478346afbda74972 WatchSource:0}: Error finding container 72e7b73222009a5e4c2525450ef82f2168f704edf523a254478346afbda74972: Status 404 returned error can't find the container with id 72e7b73222009a5e4c2525450ef82f2168f704edf523a254478346afbda74972 Jun 11 15:06:52.677022 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:52.676975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvtcz" event={"ID":"865e4df2-1b19-424d-ab92-0df8813a9c9a","Type":"ContainerStarted","Data":"48fa27ef927a980e2e0101af3da6c86ab7e5d9405db4b2b9d8deb35bfb29b28e"} Jun 11 15:06:52.678300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:52.678271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6c4b7f45-gbbmf" event={"ID":"e256dc95-2f93-436b-bac4-b0c16aaf3ffa","Type":"ContainerStarted","Data":"72e7b73222009a5e4c2525450ef82f2168f704edf523a254478346afbda74972"} Jun 11 15:06:52.729623 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:52.729514 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zvtcz" podStartSLOduration=1.479475555 podStartE2EDuration="3.72949906s" totalImagesPullingTime="2.250023505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:06:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:52.728894245 +0000 UTC m=+89.846386160" watchObservedRunningTime="2026-06-11 15:06:52.72949906 +0000 UTC m=+89.846990975" Jun 11 15:06:56.694896 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:56.694848 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6c4b7f45-gbbmf" event={"ID":"e256dc95-2f93-436b-bac4-b0c16aaf3ffa","Type":"ContainerStarted","Data":"2534e48575f3c16949ef3c59e7b0c67fcbed1e828d2a19eee506e2a4ccd7c9d5"} Jun 11 15:06:56.714583 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:56.714473 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6c4b7f45-gbbmf" podStartSLOduration=1.0427924179999999 podStartE2EDuration="5.714451658s" totalImagesPullingTime="4.67165924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:06:56.713393312 +0000 UTC m=+93.830885228" watchObservedRunningTime="2026-06-11 15:06:56.714451658 +0000 UTC m=+93.831943577" Jun 11 15:06:57.738934 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.738000 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j"] Jun 11 15:06:57.741198 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.741175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:57.744264 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.744217 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 15:06:57.744264 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.744255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jnfwh\"" Jun 11 15:06:57.744873 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.744848 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 15:06:57.744980 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.744873 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 15:06:57.745055 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.745036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 15:06:57.745117 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.745101 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 15:06:57.757264 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.757238 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm"] Jun 11 15:06:57.762120 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.762097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:57.767684 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.767093 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 15:06:57.767684 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.767460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n2sgs\"" Jun 11 15:06:57.768938 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.767951 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 15:06:57.769130 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.769108 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j"] Jun 11 15:06:57.771133 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.769784 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 15:06:57.784457 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.784401 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g2z29"] Jun 11 15:06:57.797822 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.787105 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm"] Jun 11 15:06:57.797822 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.787319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.797822 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.794021 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 15:06:57.797822 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.795130 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 15:06:57.797822 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.796123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jx4kw\"" Jun 11 15:06:57.800177 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.799165 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 15:06:57.907363 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:57.907552 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1bbe7090-499b-4966-82f2-c5ce702bf00f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:57.907552 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhmm\" (UniqueName: \"kubernetes.io/projected/01f06959-67c5-49ac-80f3-273b9629122b-kube-api-access-hwhmm\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.907552 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fcc7554-8e3e-4731-9e83-4d6e221284b5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:57.907708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-sys\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.907708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-tls\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.907708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlr95\" (UniqueName: \"kubernetes.io/projected/8fcc7554-8e3e-4731-9e83-4d6e221284b5-kube-api-access-mlr95\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:57.907708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:57.907874 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-wtmp\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.907874 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fcc7554-8e3e-4731-9e83-4d6e221284b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:57.907874 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:57.907874 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbe7090-499b-4966-82f2-c5ce702bf00f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:57.908098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-root\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.908098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.908098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.907967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-textfile\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.908098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.908051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvxz\" (UniqueName: \"kubernetes.io/projected/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-api-access-gmvxz\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:57.908098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.908083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01f06959-67c5-49ac-80f3-273b9629122b-metrics-client-ca\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.908335 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.908128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:57.908335 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:57.908172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fcc7554-8e3e-4731-9e83-4d6e221284b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.009417 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.009417 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1bbe7090-499b-4966-82f2-c5ce702bf00f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.009417 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhmm\" (UniqueName: \"kubernetes.io/projected/01f06959-67c5-49ac-80f3-273b9629122b-kube-api-access-hwhmm\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fcc7554-8e3e-4731-9e83-4d6e221284b5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-sys\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-tls\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlr95\" (UniqueName: \"kubernetes.io/projected/8fcc7554-8e3e-4731-9e83-4d6e221284b5-kube-api-access-mlr95\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-wtmp\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fcc7554-8e3e-4731-9e83-4d6e221284b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.009682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.009619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.010103 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:58.009721 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 15:06:58.010103 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:58.009743 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 15:06:58.010103 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:58.009777 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-tls podName:1bbe7090-499b-4966-82f2-c5ce702bf00f nodeName:}" failed. No retries permitted until 2026-06-11 15:06:58.50976138 +0000 UTC m=+95.627253300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-bndwm" (UID: "1bbe7090-499b-4966-82f2-c5ce702bf00f") : secret "kube-state-metrics-tls" not found Jun 11 15:06:58.010103 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:06:58.009842 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-tls podName:01f06959-67c5-49ac-80f3-273b9629122b nodeName:}" failed. No retries permitted until 2026-06-11 15:06:58.509822412 +0000 UTC m=+95.627314320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-tls") pod "node-exporter-g2z29" (UID: "01f06959-67c5-49ac-80f3-273b9629122b") : secret "node-exporter-tls" not found Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1bbe7090-499b-4966-82f2-c5ce702bf00f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-sys\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbe7090-499b-4966-82f2-c5ce702bf00f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-root\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-textfile\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-wtmp\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvxz\" (UniqueName: \"kubernetes.io/projected/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-api-access-gmvxz\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.010688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01f06959-67c5-49ac-80f3-273b9629122b-root\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01f06959-67c5-49ac-80f3-273b9629122b-metrics-client-ca\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.010688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fcc7554-8e3e-4731-9e83-4d6e221284b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.010688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fcc7554-8e3e-4731-9e83-4d6e221284b5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.010992 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.010958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01f06959-67c5-49ac-80f3-273b9629122b-metrics-client-ca\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.011509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.011015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-textfile\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.011509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.011477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bbe7090-499b-4966-82f2-c5ce702bf00f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.011697 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.011629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.013598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.013534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fcc7554-8e3e-4731-9e83-4d6e221284b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.013705 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.013670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fcc7554-8e3e-4731-9e83-4d6e221284b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.014711 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.014676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.015114 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.015091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.020929 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.020906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlr95\" (UniqueName: \"kubernetes.io/projected/8fcc7554-8e3e-4731-9e83-4d6e221284b5-kube-api-access-mlr95\") pod \"openshift-state-metrics-65f78d5c66-7b65j\" (UID: \"8fcc7554-8e3e-4731-9e83-4d6e221284b5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.021947 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.021283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhmm\" (UniqueName: \"kubernetes.io/projected/01f06959-67c5-49ac-80f3-273b9629122b-kube-api-access-hwhmm\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.022583 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.022554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvxz\" (UniqueName: \"kubernetes.io/projected/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-api-access-gmvxz\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.054634 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.054595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" Jun 11 15:06:58.242218 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.242183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j"] Jun 11 15:06:58.245635 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:58.245609 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fcc7554_8e3e_4731_9e83_4d6e221284b5.slice/crio-566b78afb0e4c6e29116549c77fb886556307f627b419468c39c9782893d78ff WatchSource:0}: Error finding container 566b78afb0e4c6e29116549c77fb886556307f627b419468c39c9782893d78ff: Status 404 returned error can't find the container with id 566b78afb0e4c6e29116549c77fb886556307f627b419468c39c9782893d78ff Jun 11 15:06:58.514658 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.514631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.514842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.514730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-tls\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.517249 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.517225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01f06959-67c5-49ac-80f3-273b9629122b-node-exporter-tls\") pod \"node-exporter-g2z29\" (UID: \"01f06959-67c5-49ac-80f3-273b9629122b\") " pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.517365 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.517287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbe7090-499b-4966-82f2-c5ce702bf00f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bndwm\" (UID: \"1bbe7090-499b-4966-82f2-c5ce702bf00f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.674749 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.674703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" Jun 11 15:06:58.704251 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.704224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g2z29" Jun 11 15:06:58.705252 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.705228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" event={"ID":"8fcc7554-8e3e-4731-9e83-4d6e221284b5","Type":"ContainerStarted","Data":"dd3a38aa4bd1f547bc6cefb07d7954acb00f9ab4edb4393f47d8a60efbf607fe"} Jun 11 15:06:58.705372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.705286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" event={"ID":"8fcc7554-8e3e-4731-9e83-4d6e221284b5","Type":"ContainerStarted","Data":"3ec488fd1039e90cd6b742505a37021eb9564b7309474ba053d6c5dcf9bb5c25"} Jun 11 15:06:58.705372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.705314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" event={"ID":"8fcc7554-8e3e-4731-9e83-4d6e221284b5","Type":"ContainerStarted","Data":"566b78afb0e4c6e29116549c77fb886556307f627b419468c39c9782893d78ff"} Jun 11 15:06:58.714522 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:58.714475 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f06959_67c5_49ac_80f3_273b9629122b.slice/crio-dd4553f54413e79f465903ce6ab96eed257b1fcece9fb37d399430aabd2fbe52 WatchSource:0}: Error finding container dd4553f54413e79f465903ce6ab96eed257b1fcece9fb37d399430aabd2fbe52: Status 404 returned error can't find the container with id dd4553f54413e79f465903ce6ab96eed257b1fcece9fb37d399430aabd2fbe52 Jun 11 15:06:58.827703 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.827669 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:06:58.832331 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.832305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:58.843326 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.843296 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:06:58.843713 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.843691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-csrkm\"" Jun 11 15:06:58.844903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.844505 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:06:58.844903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.844602 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:06:58.844903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.844669 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:06:58.844903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.844715 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:06:58.844903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.844777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:06:58.845195 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.844935 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:06:58.845195 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.845014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:06:58.845195 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.845032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:06:58.845599 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.845582 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm"] Jun 11 15:06:58.847718 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:58.847696 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbe7090_499b_4966_82f2_c5ce702bf00f.slice/crio-66209c2e8c2d232552c6438410cf6b3491ee7af0a1d59df6c3c6b9cd11f5a927 WatchSource:0}: Error finding container 66209c2e8c2d232552c6438410cf6b3491ee7af0a1d59df6c3c6b9cd11f5a927: Status 404 returned error can't find the container with id 66209c2e8c2d232552c6438410cf6b3491ee7af0a1d59df6c3c6b9cd11f5a927 Jun 11 15:06:58.859947 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:58.859858 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:06:59.019319 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-web-config\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019926 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019926 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-out\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019926 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptcpj\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-kube-api-access-ptcpj\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019926 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.019926 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.019706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120219 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120219 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-web-config\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-out\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptcpj\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-kube-api-access-ptcpj\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120860 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120860 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.120860 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.120598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.122448 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.122030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.122675 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.122646 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.123883 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.123855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.125316 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.125273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.125316 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.125309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-out\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.125932 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.125909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.127267 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.127243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.127350 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.127310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.127350 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.127341 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-web-config\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.127707 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.127687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.127792 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.127692 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.128183 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.128160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.131785 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.131763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptcpj\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-kube-api-access-ptcpj\") pod \"alertmanager-main-0\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.145746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.145529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:06:59.316816 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.316704 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:06:59.322321 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:06:59.322281 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1a5b8e_1943_44a2_a8fd_8386c20a2a0c.slice/crio-beddf468337e4192b80ef5f9582da31ec6859ea7a318ed9cb0b3efe08be352b1 WatchSource:0}: Error finding container beddf468337e4192b80ef5f9582da31ec6859ea7a318ed9cb0b3efe08be352b1: Status 404 returned error can't find the container with id beddf468337e4192b80ef5f9582da31ec6859ea7a318ed9cb0b3efe08be352b1 Jun 11 15:06:59.714110 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.713722 2576 patch_prober.go:28] interesting pod/image-registry-6847869686-72s7x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 15:06:59.714110 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.713815 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6847869686-72s7x" podUID="f2b35e69-52bb-44c9-b51c-fbe63520df6f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:06:59.720708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.720667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerStarted","Data":"beddf468337e4192b80ef5f9582da31ec6859ea7a318ed9cb0b3efe08be352b1"} Jun 11 15:06:59.723095 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.723061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" event={"ID":"1bbe7090-499b-4966-82f2-c5ce702bf00f","Type":"ContainerStarted","Data":"66209c2e8c2d232552c6438410cf6b3491ee7af0a1d59df6c3c6b9cd11f5a927"} Jun 11 15:06:59.724913 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:06:59.724877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2z29" event={"ID":"01f06959-67c5-49ac-80f3-273b9629122b","Type":"ContainerStarted","Data":"dd4553f54413e79f465903ce6ab96eed257b1fcece9fb37d399430aabd2fbe52"} Jun 11 15:07:00.733664 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.732004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" event={"ID":"8fcc7554-8e3e-4731-9e83-4d6e221284b5","Type":"ContainerStarted","Data":"43749845e86c7eb5f6a629f65334e2a95292ab68bf726bee6a4edeb08714a956"} Jun 11 15:07:00.737760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.736738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" event={"ID":"1bbe7090-499b-4966-82f2-c5ce702bf00f","Type":"ContainerStarted","Data":"4e425319b3ea94a19077f6fb8aa041379c2290668d8a179ceee8157ab223e480"} Jun 11 15:07:00.740085 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.739547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2z29" event={"ID":"01f06959-67c5-49ac-80f3-273b9629122b","Type":"ContainerStarted","Data":"d892fa7c23afcba7981ac21b0924c42f4c5d423614f023e11b43b276dfcad558"} Jun 11 15:07:00.752303 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.752240 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7b65j" podStartSLOduration=1.776964043 podStartE2EDuration="3.752221918s" totalImagesPullingTime="1.975257875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:00.752135208 +0000 UTC m=+97.869627125" watchObservedRunningTime="2026-06-11 15:07:00.752221918 +0000 UTC m=+97.869713835" Jun 11 15:07:00.834968 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.834622 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9bd8686f8-9kc48"] Jun 11 15:07:00.840614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.840554 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:00.852903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.851964 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-77di7i1jp10at\"" Jun 11 15:07:00.852903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.852199 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 15:07:00.852903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.852232 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 15:07:00.852903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.852394 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 15:07:00.852903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.852424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 15:07:00.852903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.852576 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 15:07:00.852903 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.852752 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5gsg2\"" Jun 11 15:07:00.861587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:00.861560 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9bd8686f8-9kc48"] Jun 11 15:07:01.042604 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbqdb\" (UniqueName: \"kubernetes.io/projected/15878bfd-d9db-417e-8122-262f8b8674cd-kube-api-access-hbqdb\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.042720 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-grpc-tls\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.042720 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.042720 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-tls\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.042852 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.042899 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.042957 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15878bfd-d9db-417e-8122-262f8b8674cd-metrics-client-ca\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.043028 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.042999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144307 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15878bfd-d9db-417e-8122-262f8b8674cd-metrics-client-ca\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144640 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbqdb\" (UniqueName: \"kubernetes.io/projected/15878bfd-d9db-417e-8122-262f8b8674cd-kube-api-access-hbqdb\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144640 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-grpc-tls\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144737 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.144869 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.144841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-tls\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.145385 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.145331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15878bfd-d9db-417e-8122-262f8b8674cd-metrics-client-ca\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.147674 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.147648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-grpc-tls\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.147824 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.147777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.147905 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.147886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.148404 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.148380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.148480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.148415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-tls\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.148653 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.148635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15878bfd-d9db-417e-8122-262f8b8674cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.152718 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.152695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbqdb\" (UniqueName: \"kubernetes.io/projected/15878bfd-d9db-417e-8122-262f8b8674cd-kube-api-access-hbqdb\") pod \"thanos-querier-9bd8686f8-9kc48\" (UID: \"15878bfd-d9db-417e-8122-262f8b8674cd\") " pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.156306 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.156285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:01.323771 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.323743 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9bd8686f8-9kc48"] Jun 11 15:07:01.325353 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:01.325303 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15878bfd_d9db_417e_8122_262f8b8674cd.slice/crio-2387ec6739283c5705a65f42b1c920b52341c05aaec0686f82c52e4f7c3dbe53 WatchSource:0}: Error finding container 2387ec6739283c5705a65f42b1c920b52341c05aaec0686f82c52e4f7c3dbe53: Status 404 returned error can't find the container with id 2387ec6739283c5705a65f42b1c920b52341c05aaec0686f82c52e4f7c3dbe53 Jun 11 15:07:01.598090 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.598059 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v7gx5" Jun 11 15:07:01.623408 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.623379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:07:01.623546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.623429 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:07:01.624632 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.624601 2576 patch_prober.go:28] interesting pod/console-6b6c4b7f45-gbbmf container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 11 15:07:01.624742 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.624649 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6b6c4b7f45-gbbmf" podUID="e256dc95-2f93-436b-bac4-b0c16aaf3ffa" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 11 15:07:01.724209 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.724176 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-776f74bdbc-wh2ks"] Jun 11 15:07:01.728950 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.728930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.738912 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.738884 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 15:07:01.744232 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.744208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f74bdbc-wh2ks"] Jun 11 15:07:01.745183 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.745156 2576 generic.go:356] "Generic (PLEG): container finished" podID="01f06959-67c5-49ac-80f3-273b9629122b" containerID="d892fa7c23afcba7981ac21b0924c42f4c5d423614f023e11b43b276dfcad558" exitCode=0 Jun 11 15:07:01.745276 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.745239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2z29" event={"ID":"01f06959-67c5-49ac-80f3-273b9629122b","Type":"ContainerDied","Data":"d892fa7c23afcba7981ac21b0924c42f4c5d423614f023e11b43b276dfcad558"} Jun 11 15:07:01.746991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.746960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" event={"ID":"15878bfd-d9db-417e-8122-262f8b8674cd","Type":"ContainerStarted","Data":"2387ec6739283c5705a65f42b1c920b52341c05aaec0686f82c52e4f7c3dbe53"} Jun 11 15:07:01.749510 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749481 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerID="942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d" exitCode=0 Jun 11 15:07:01.749593 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d"} Jun 11 15:07:01.749663 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-console-config\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.749722 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-service-ca\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.749775 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-trusted-ca-bundle\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.749853 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-oauth-serving-cert\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.749909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qk9t\" (UniqueName: \"kubernetes.io/projected/03e386e0-be48-473d-8fae-3c776bddd53e-kube-api-access-9qk9t\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.750055 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.749997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-serving-cert\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.750055 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.750045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-oauth-config\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.752451 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.752430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" event={"ID":"1bbe7090-499b-4966-82f2-c5ce702bf00f","Type":"ContainerStarted","Data":"cc6ca1bc481ec6266f9676bc845ab7346e72e96f28bc18af0992c0988074dc5d"} Jun 11 15:07:01.752556 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.752471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" event={"ID":"1bbe7090-499b-4966-82f2-c5ce702bf00f","Type":"ContainerStarted","Data":"8ef4b9a9684408884f9e52ad7f01686be494fa02fc4cb9a4f0770df760162420"} Jun 11 15:07:01.839167 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.838951 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bndwm" podStartSLOduration=3.3253903879999998 podStartE2EDuration="4.838928565s" totalImagesPullingTime="1.513538177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:01.836512784 +0000 UTC m=+98.954004701" watchObservedRunningTime="2026-06-11 15:07:01.838928565 +0000 UTC m=+98.956420482" Jun 11 15:07:01.851651 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.851592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-serving-cert\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.852175 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.852154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-oauth-config\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.853381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.853352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-console-config\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.853473 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.853416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-service-ca\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.853892 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.853869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-trusted-ca-bundle\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.853975 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.853934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-oauth-serving-cert\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.854045 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.854026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qk9t\" (UniqueName: \"kubernetes.io/projected/03e386e0-be48-473d-8fae-3c776bddd53e-kube-api-access-9qk9t\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.854724 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.854089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-console-config\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.854724 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.854291 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-service-ca\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.854724 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.854682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-oauth-serving-cert\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.855086 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.855066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-trusted-ca-bundle\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.855186 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.855162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-oauth-config\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.855486 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.855466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-serving-cert\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:01.862620 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:01.862590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qk9t\" (UniqueName: \"kubernetes.io/projected/03e386e0-be48-473d-8fae-3c776bddd53e-kube-api-access-9qk9t\") pod \"console-776f74bdbc-wh2ks\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:02.043938 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.043900 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:02.208488 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.208456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-776f74bdbc-wh2ks"] Jun 11 15:07:02.212865 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:02.212835 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e386e0_be48_473d_8fae_3c776bddd53e.slice/crio-2c2b7171ac3ddb316741991e1fff1743c66d0f85237a61b7d3719fd0fedea957 WatchSource:0}: Error finding container 2c2b7171ac3ddb316741991e1fff1743c66d0f85237a61b7d3719fd0fedea957: Status 404 returned error can't find the container with id 2c2b7171ac3ddb316741991e1fff1743c66d0f85237a61b7d3719fd0fedea957 Jun 11 15:07:02.238255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.237365 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7fcbc4789d-7vl2r"] Jun 11 15:07:02.242949 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.242927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.248551 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.248529 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 15:07:02.248551 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.248541 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:07:02.249169 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.249149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jghg9\"" Jun 11 15:07:02.249169 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.249161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 15:07:02.249289 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.249161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dj4qfs9jpt1fv\"" Jun 11 15:07:02.249289 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.249147 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 15:07:02.257658 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.257631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fcbc4789d-7vl2r"] Jun 11 15:07:02.257839 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.257820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-client-ca-bundle\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.257916 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.257885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2318b100-5e3c-430a-b3db-f96b629b851b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.257916 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.257910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2318b100-5e3c-430a-b3db-f96b629b851b-audit-log\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.258010 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.257942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-secret-metrics-server-client-certs\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.258010 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.257967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2318b100-5e3c-430a-b3db-f96b629b851b-metrics-server-audit-profiles\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.258010 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.258002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-secret-metrics-server-tls\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.258152 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.258067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:07:02.258152 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.258094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s2jf\" (UniqueName: \"kubernetes.io/projected/2318b100-5e3c-430a-b3db-f96b629b851b-kube-api-access-9s2jf\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.260947 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.260926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98c5ab4c-7d81-4f98-bb75-0b3008f7939e-metrics-tls\") pod \"dns-default-7vg56\" (UID: \"98c5ab4c-7d81-4f98-bb75-0b3008f7939e\") " pod="openshift-dns/dns-default-7vg56" Jun 11 15:07:02.358768 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.358695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-client-ca-bundle\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.358906 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.358780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2318b100-5e3c-430a-b3db-f96b629b851b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.358906 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.358828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2318b100-5e3c-430a-b3db-f96b629b851b-audit-log\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.358906 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.358863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-secret-metrics-server-client-certs\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.358906 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.358887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2318b100-5e3c-430a-b3db-f96b629b851b-metrics-server-audit-profiles\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.359122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.358926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-secret-metrics-server-tls\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.359122 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.358996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s2jf\" (UniqueName: \"kubernetes.io/projected/2318b100-5e3c-430a-b3db-f96b629b851b-kube-api-access-9s2jf\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.359519 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.359447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2318b100-5e3c-430a-b3db-f96b629b851b-audit-log\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.360071 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.360047 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2318b100-5e3c-430a-b3db-f96b629b851b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.360171 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.360136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2318b100-5e3c-430a-b3db-f96b629b851b-metrics-server-audit-profiles\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.361294 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.361267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-secret-metrics-server-client-certs\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.361881 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.361842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-secret-metrics-server-tls\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.361960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.361933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2318b100-5e3c-430a-b3db-f96b629b851b-client-ca-bundle\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.371880 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.371859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s2jf\" (UniqueName: \"kubernetes.io/projected/2318b100-5e3c-430a-b3db-f96b629b851b-kube-api-access-9s2jf\") pod \"metrics-server-7fcbc4789d-7vl2r\" (UID: \"2318b100-5e3c-430a-b3db-f96b629b851b\") " pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.502832 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.501004 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh"] Jun 11 15:07:02.502832 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.502642 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8hpwp\"" Jun 11 15:07:02.503883 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.503660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vg56" Jun 11 15:07:02.504733 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.504701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:02.506778 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.506591 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 15:07:02.506926 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.506875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hmpds\"" Jun 11 15:07:02.511142 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.511120 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh"] Jun 11 15:07:02.560390 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.560341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ph2\" (UniqueName: \"kubernetes.io/projected/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-kube-api-access-w6ph2\") pod \"monitoring-plugin-76b68cc874-kvdgh\" (UID: \"39808e83-f545-4bcd-a17a-22c1b0a0fbcc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:02.560592 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.560422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kvdgh\" (UID: \"39808e83-f545-4bcd-a17a-22c1b0a0fbcc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:02.627231 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.626940 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:02.661564 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.661532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ph2\" (UniqueName: \"kubernetes.io/projected/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-kube-api-access-w6ph2\") pod \"monitoring-plugin-76b68cc874-kvdgh\" (UID: \"39808e83-f545-4bcd-a17a-22c1b0a0fbcc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:02.661794 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.661614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kvdgh\" (UID: \"39808e83-f545-4bcd-a17a-22c1b0a0fbcc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:02.661794 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:07:02.661743 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 15:07:02.662022 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:07:02.661826 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-monitoring-plugin-cert podName:39808e83-f545-4bcd-a17a-22c1b0a0fbcc nodeName:}" failed. No retries permitted until 2026-06-11 15:07:03.161780769 +0000 UTC m=+100.279272679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-kvdgh" (UID: "39808e83-f545-4bcd-a17a-22c1b0a0fbcc") : secret "monitoring-plugin-cert" not found Jun 11 15:07:02.667909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.667793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vg56"] Jun 11 15:07:02.672849 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.672683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ph2\" (UniqueName: \"kubernetes.io/projected/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-kube-api-access-w6ph2\") pod \"monitoring-plugin-76b68cc874-kvdgh\" (UID: \"39808e83-f545-4bcd-a17a-22c1b0a0fbcc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:02.674048 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:02.674013 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c5ab4c_7d81_4f98_bb75_0b3008f7939e.slice/crio-c576d7545d83ce851176972136097f45c639cdb850c99a80ca22e0e87f60d6e0 WatchSource:0}: Error finding container c576d7545d83ce851176972136097f45c639cdb850c99a80ca22e0e87f60d6e0: Status 404 returned error can't find the container with id c576d7545d83ce851176972136097f45c639cdb850c99a80ca22e0e87f60d6e0 Jun 11 15:07:02.772722 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.772680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f74bdbc-wh2ks" event={"ID":"03e386e0-be48-473d-8fae-3c776bddd53e","Type":"ContainerStarted","Data":"058a02bcdf661898c94eb9c93bfcbc21d527be7bf017714ddbe60867c3d5613a"} Jun 11 15:07:02.773177 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.772781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f74bdbc-wh2ks" event={"ID":"03e386e0-be48-473d-8fae-3c776bddd53e","Type":"ContainerStarted","Data":"2c2b7171ac3ddb316741991e1fff1743c66d0f85237a61b7d3719fd0fedea957"} Jun 11 15:07:02.775250 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.775220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vg56" event={"ID":"98c5ab4c-7d81-4f98-bb75-0b3008f7939e","Type":"ContainerStarted","Data":"c576d7545d83ce851176972136097f45c639cdb850c99a80ca22e0e87f60d6e0"} Jun 11 15:07:02.779389 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.779356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2z29" event={"ID":"01f06959-67c5-49ac-80f3-273b9629122b","Type":"ContainerStarted","Data":"0fdbe13ba1924d81642a1c65456b5fcca21066a3776db6e7c2c57143ab95930c"} Jun 11 15:07:02.779491 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.779409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2z29" event={"ID":"01f06959-67c5-49ac-80f3-273b9629122b","Type":"ContainerStarted","Data":"418832fa1c9d5ed8953a31e35a234449d527ef687c35b08b2bf0b19e63d8678a"} Jun 11 15:07:02.794945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.794876 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-776f74bdbc-wh2ks" podStartSLOduration=1.794855669 podStartE2EDuration="1.794855669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:02.792673227 +0000 UTC m=+99.910165141" watchObservedRunningTime="2026-06-11 15:07:02.794855669 +0000 UTC m=+99.912347588" Jun 11 15:07:02.809476 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.809071 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fcbc4789d-7vl2r"] Jun 11 15:07:02.814838 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.814590 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g2z29" podStartSLOduration=4.075164541 podStartE2EDuration="5.814570498s" totalImagesPullingTime="1.643655258s" totalInitContainerRuntime="95.750699ms" isStatefulPod=true podCreationTimestamp="2026-06-11 15:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:02.813255285 +0000 UTC m=+99.930747199" watchObservedRunningTime="2026-06-11 15:07:02.814570498 +0000 UTC m=+99.932062414" Jun 11 15:07:02.815767 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:02.815512 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2318b100_5e3c_430a_b3db_f96b629b851b.slice/crio-4116fae54fb9cecb7f95ee1972f58bd36619a304548b16c0b0cdf87c15be421e WatchSource:0}: Error finding container 4116fae54fb9cecb7f95ee1972f58bd36619a304548b16c0b0cdf87c15be421e: Status 404 returned error can't find the container with id 4116fae54fb9cecb7f95ee1972f58bd36619a304548b16c0b0cdf87c15be421e Jun 11 15:07:02.994265 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.994176 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-694cd9f5b5-nht6c"] Jun 11 15:07:02.998462 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:02.998435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.000960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.000777 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 15:07:03.000960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.000820 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 15:07:03.000960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.000853 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 15:07:03.000960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.000867 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-s7q2g\"" Jun 11 15:07:03.000960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.000913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 15:07:03.000960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.000777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 15:07:03.007897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.007875 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 15:07:03.013116 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.013095 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-694cd9f5b5-nht6c"] Jun 11 15:07:03.067525 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.067698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-serving-certs-ca-bundle\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.067698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-telemeter-client-tls\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.067698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-federate-client-tls\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.067698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.067698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sznkf\" (UniqueName: \"kubernetes.io/projected/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-kube-api-access-sznkf\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.067698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-secret-telemeter-client\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.068109 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.067700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-metrics-client-ca\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.168715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-secret-telemeter-client\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.168766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-metrics-client-ca\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.168889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.168927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-serving-certs-ca-bundle\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.168951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-telemeter-client-tls\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.168976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-federate-client-tls\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.169005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.169024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sznkf\" (UniqueName: \"kubernetes.io/projected/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-kube-api-access-sznkf\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.169521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.169056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kvdgh\" (UID: \"39808e83-f545-4bcd-a17a-22c1b0a0fbcc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:03.170176 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.170137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-metrics-client-ca\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.170176 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.170162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.170507 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.170483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-serving-certs-ca-bundle\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.173196 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.173166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-telemeter-client-tls\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.173515 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.173489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-secret-telemeter-client\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.174696 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.174653 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39808e83-f545-4bcd-a17a-22c1b0a0fbcc-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kvdgh\" (UID: \"39808e83-f545-4bcd-a17a-22c1b0a0fbcc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:03.175135 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.175108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.176176 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.176155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-federate-client-tls\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.178526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.178501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sznkf\" (UniqueName: \"kubernetes.io/projected/dca7e6c9-4f48-4ca9-b439-22c49b9cb73a-kube-api-access-sznkf\") pod \"telemeter-client-694cd9f5b5-nht6c\" (UID: \"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a\") " pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.311955 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.311916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" Jun 11 15:07:03.418743 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.418704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:03.790687 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.789788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" event={"ID":"2318b100-5e3c-430a-b3db-f96b629b851b","Type":"ContainerStarted","Data":"4116fae54fb9cecb7f95ee1972f58bd36619a304548b16c0b0cdf87c15be421e"} Jun 11 15:07:03.986298 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:03.986263 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:07:04.011472 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.011444 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:07:04.011615 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.011569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.014039 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:07:04.014039 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4q475kkog38mq\"" Jun 11 15:07:04.014307 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014288 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:07:04.014424 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014389 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:07:04.014480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:07:04.014480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014459 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:07:04.014567 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:07:04.014567 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014555 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:07:04.014712 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.014695 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:07:04.015016 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.015000 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7ptxx\"" Jun 11 15:07:04.016394 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.016373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:07:04.016394 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.016387 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:07:04.016535 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.016379 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:07:04.016601 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.016581 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:07:04.016680 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.016664 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:07:04.018550 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.018397 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:07:04.078750 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.078750 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.078952 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.078952 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.078952 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.078952 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.078952 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.078981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqz6q\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-kube-api-access-pqz6q\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.079498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.079472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180492 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180680 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqz6q\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-kube-api-access-pqz6q\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180680 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180680 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180680 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180680 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.180981 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.180982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.181380 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.181006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.181380 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.181033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.181380 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.181056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.181380 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.181088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.181380 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.181113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.181670 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.181645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.182331 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.181977 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.183668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.182776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.183668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.183239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.183668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.183500 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.184307 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.183912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.188305 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.188277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.189026 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.188792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.189026 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.188988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.189338 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.189200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.191422 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.191233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.191529 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.191479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.191955 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.191930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.192409 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.192386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.192741 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.192717 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.193137 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.193118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.193521 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.193493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.194233 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.194196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.195321 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.195299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.196729 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.196706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqz6q\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-kube-api-access-pqz6q\") pod \"prometheus-k8s-0\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:04.322504 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:04.322469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:05.724231 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:05.723954 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-694cd9f5b5-nht6c"] Jun 11 15:07:05.749254 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:05.749137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:07:05.800025 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:05.799924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vg56" event={"ID":"98c5ab4c-7d81-4f98-bb75-0b3008f7939e","Type":"ContainerStarted","Data":"7c1824263ea0318c4ded97261f33ad6376bc337a2d4d05e94db5a0b371048bf9"} Jun 11 15:07:05.802922 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:05.802890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" event={"ID":"15878bfd-d9db-417e-8122-262f8b8674cd","Type":"ContainerStarted","Data":"7d917e2efe77673da755d8e6186b383236f4e93befb0326d9255a6e0ae7bd7b8"} Jun 11 15:07:05.908416 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:05.908380 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca7e6c9_4f48_4ca9_b439_22c49b9cb73a.slice/crio-3ae8d36692ea2d84f2d9bf17f5944411d1f08640468b2ba42c3bea35baeb9a4f WatchSource:0}: Error finding container 3ae8d36692ea2d84f2d9bf17f5944411d1f08640468b2ba42c3bea35baeb9a4f: Status 404 returned error can't find the container with id 3ae8d36692ea2d84f2d9bf17f5944411d1f08640468b2ba42c3bea35baeb9a4f Jun 11 15:07:05.909223 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:05.909102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d68719f_6786_43c7_ab7a_bf0ed43a85f9.slice/crio-ddacf65902f2b6751aff6dd5af1ef998b6c860bc4bcc6d01a28529b57ef54ccd WatchSource:0}: Error finding container ddacf65902f2b6751aff6dd5af1ef998b6c860bc4bcc6d01a28529b57ef54ccd: Status 404 returned error can't find the container with id ddacf65902f2b6751aff6dd5af1ef998b6c860bc4bcc6d01a28529b57ef54ccd Jun 11 15:07:05.938723 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:05.938696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh"] Jun 11 15:07:06.404695 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:06.404641 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39808e83_f545_4bcd_a17a_22c1b0a0fbcc.slice/crio-6d3fa5203e9d71813f1c0a600c85186b3c71758a625c6e20081e7a5be9254698 WatchSource:0}: Error finding container 6d3fa5203e9d71813f1c0a600c85186b3c71758a625c6e20081e7a5be9254698: Status 404 returned error can't find the container with id 6d3fa5203e9d71813f1c0a600c85186b3c71758a625c6e20081e7a5be9254698 Jun 11 15:07:06.808698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:06.808650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" event={"ID":"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a","Type":"ContainerStarted","Data":"3ae8d36692ea2d84f2d9bf17f5944411d1f08640468b2ba42c3bea35baeb9a4f"} Jun 11 15:07:06.810173 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:06.810147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" event={"ID":"39808e83-f545-4bcd-a17a-22c1b0a0fbcc","Type":"ContainerStarted","Data":"6d3fa5203e9d71813f1c0a600c85186b3c71758a625c6e20081e7a5be9254698"} Jun 11 15:07:06.811493 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:06.811464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerStarted","Data":"ddacf65902f2b6751aff6dd5af1ef998b6c860bc4bcc6d01a28529b57ef54ccd"} Jun 11 15:07:08.698259 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:08.698208 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6c4b7f45-gbbmf"] Jun 11 15:07:09.711113 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:09.711082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:07:12.044939 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:12.044901 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:12.045409 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:12.045250 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:12.051108 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:12.051086 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:12.846214 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:12.846187 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:14.725389 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.725298 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6847869686-72s7x" podUID="f2b35e69-52bb-44c9-b51c-fbe63520df6f" containerName="registry" containerID="cri-o://1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51" gracePeriod=30 Jun 11 15:07:14.856013 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.855970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" event={"ID":"15878bfd-d9db-417e-8122-262f8b8674cd","Type":"ContainerStarted","Data":"29d2d173ba9384514a22b286147d39a08a19b9d2fd8a19f0e41ffe7902170b0e"} Jun 11 15:07:14.856206 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.856089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" event={"ID":"15878bfd-d9db-417e-8122-262f8b8674cd","Type":"ContainerStarted","Data":"3da147af2a83bae6d08173d99e4d9409098f4bc16c0599bdaec879a4be5eef05"} Jun 11 15:07:14.858339 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.858165 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" exitCode=0 Jun 11 15:07:14.858339 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.858266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3"} Jun 11 15:07:14.861933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.861903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" event={"ID":"2318b100-5e3c-430a-b3db-f96b629b851b","Type":"ContainerStarted","Data":"b419eadd540670f813fd0ab13633cc75fcab61256f322b2c8c6778e5a88db84b"} Jun 11 15:07:14.868106 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.867871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerStarted","Data":"88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd"} Jun 11 15:07:14.868106 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.867960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerStarted","Data":"4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006"} Jun 11 15:07:14.868106 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.868001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerStarted","Data":"8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2"} Jun 11 15:07:14.868106 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.868041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerStarted","Data":"08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2"} Jun 11 15:07:14.870972 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.870316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vg56" event={"ID":"98c5ab4c-7d81-4f98-bb75-0b3008f7939e","Type":"ContainerStarted","Data":"4066006406ac11165ec1445268988b93e73d65d9839aa725801a41fe541118c5"} Jun 11 15:07:14.870972 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.870920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7vg56" Jun 11 15:07:14.873944 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.873286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" event={"ID":"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a","Type":"ContainerStarted","Data":"e50b40416debf125d4a2def16785e558ebc9829a6d766352f10917566a653654"} Jun 11 15:07:14.873944 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.873323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" event={"ID":"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a","Type":"ContainerStarted","Data":"e792320a5224dfb7114c69d118d9ba9fcf498daa921c72fe57b64a5b05a105f7"} Jun 11 15:07:14.873944 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.873341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" event={"ID":"dca7e6c9-4f48-4ca9-b439-22c49b9cb73a","Type":"ContainerStarted","Data":"6e4871060f69f0f4378d1fa2d24fdc372d350b4b87350884946fad40e4cca4c1"} Jun 11 15:07:14.876121 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.876099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-rkt8q" event={"ID":"b0643eb0-5d90-429a-9226-10a6a9bb41fa","Type":"ContainerStarted","Data":"00e2eec59d57b95ef74a05736053014a5382f3208347cf08055882ebdb29c571"} Jun 11 15:07:14.876280 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.876267 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-rkt8q" Jun 11 15:07:14.889352 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.889303 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-rkt8q" Jun 11 15:07:14.904072 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.903757 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" podStartSLOduration=1.5251298279999999 podStartE2EDuration="12.903738373s" totalImagesPullingTime="11.378608545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:14.903442806 +0000 UTC m=+112.020934735" watchObservedRunningTime="2026-06-11 15:07:14.903738373 +0000 UTC m=+112.021230289" Jun 11 15:07:14.920187 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.920129 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-rkt8q" podStartSLOduration=1.8485168509999998 podStartE2EDuration="25.920108653s" totalImagesPullingTime="24.071591802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:14.918503566 +0000 UTC m=+112.035995473" watchObservedRunningTime="2026-06-11 15:07:14.920108653 +0000 UTC m=+112.037600572" Jun 11 15:07:14.942708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.940714 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-694cd9f5b5-nht6c" podStartSLOduration=4.603670159 podStartE2EDuration="12.940692812s" totalImagesPullingTime="8.337022653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:14.938845206 +0000 UTC m=+112.056337121" watchObservedRunningTime="2026-06-11 15:07:14.940692812 +0000 UTC m=+112.058184729" Jun 11 15:07:14.956197 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:14.956131 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7vg56" podStartSLOduration=74.096308201 podStartE2EDuration="1m16.95611107s" totalImagesPullingTime="2.859802869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:14.954269103 +0000 UTC m=+112.071761048" watchObservedRunningTime="2026-06-11 15:07:14.95611107 +0000 UTC m=+112.073602986" Jun 11 15:07:15.367171 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.367143 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:07:15.512097 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512061 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b35e69-52bb-44c9-b51c-fbe63520df6f-ca-trust-extracted\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.512279 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512111 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-image-registry-private-configuration\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.512279 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512151 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-bound-sa-token\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.512279 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512176 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qct9p\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-kube-api-access-qct9p\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.512279 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512199 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-installation-pull-secrets\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.512279 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512236 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-certificates\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.512279 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512256 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-trusted-ca\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.512560 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.512283 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") pod \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\" (UID: \"f2b35e69-52bb-44c9-b51c-fbe63520df6f\") " Jun 11 15:07:15.513505 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.513448 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:15.514140 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.514108 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:15.522733 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.522686 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-kube-api-access-qct9p" (OuterVolumeSpecName: "kube-api-access-qct9p") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "kube-api-access-qct9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:07:15.524221 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.524168 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:07:15.525690 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.525663 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2b35e69-52bb-44c9-b51c-fbe63520df6f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:07:15.526277 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.526246 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:07:15.528307 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.528272 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:07:15.529356 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.529326 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f2b35e69-52bb-44c9-b51c-fbe63520df6f" (UID: "f2b35e69-52bb-44c9-b51c-fbe63520df6f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613597 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-image-registry-private-configuration\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613633 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-bound-sa-token\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613650 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qct9p\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-kube-api-access-qct9p\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613664 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b35e69-52bb-44c9-b51c-fbe63520df6f-installation-pull-secrets\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613677 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-certificates\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613691 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b35e69-52bb-44c9-b51c-fbe63520df6f-trusted-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613705 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b35e69-52bb-44c9-b51c-fbe63520df6f-registry-tls\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.613698 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.613714 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b35e69-52bb-44c9-b51c-fbe63520df6f-ca-trust-extracted\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:15.888115 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.888073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerStarted","Data":"e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc"} Jun 11 15:07:15.890287 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.889920 2576 generic.go:356] "Generic (PLEG): container finished" podID="f2b35e69-52bb-44c9-b51c-fbe63520df6f" containerID="1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51" exitCode=0 Jun 11 15:07:15.890287 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.890055 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847869686-72s7x" event={"ID":"f2b35e69-52bb-44c9-b51c-fbe63520df6f","Type":"ContainerDied","Data":"1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51"} Jun 11 15:07:15.890287 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.890102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6847869686-72s7x" event={"ID":"f2b35e69-52bb-44c9-b51c-fbe63520df6f","Type":"ContainerDied","Data":"19ca75dfa50ab5a36cbef7fde663f4f96f7c415758a76c52b042471f658933a9"} Jun 11 15:07:15.890287 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.890148 2576 scope.go:117] "RemoveContainer" containerID="1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51" Jun 11 15:07:15.890287 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.890060 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6847869686-72s7x" Jun 11 15:07:15.894073 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.894046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" event={"ID":"39808e83-f545-4bcd-a17a-22c1b0a0fbcc","Type":"ContainerStarted","Data":"490fed1502f3b80d76d79ac48b743da58fb0decd00410f913644562890875c8e"} Jun 11 15:07:15.897906 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.895355 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:15.898005 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.897978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7vg56" Jun 11 15:07:15.901385 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.901359 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" Jun 11 15:07:15.904131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.903942 2576 scope.go:117] "RemoveContainer" containerID="1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51" Jun 11 15:07:15.904579 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:07:15.904548 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51\": container with ID starting with 1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51 not found: ID does not exist" containerID="1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51" Jun 11 15:07:15.904678 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.904592 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51"} err="failed to get container status \"1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51\": rpc error: code = NotFound desc = could not find container \"1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51\": container with ID starting with 1cdef1ef9960550a9267eb786b9e1037b41d6a037f191b5590ee715a43b08f51 not found: ID does not exist" Jun 11 15:07:15.939284 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.939131 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kvdgh" podStartSLOduration=4.990538516 podStartE2EDuration="13.939109465s" totalImagesPullingTime="8.948570949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:15.917107312 +0000 UTC m=+113.034599242" watchObservedRunningTime="2026-06-11 15:07:15.939109465 +0000 UTC m=+113.056601383" Jun 11 15:07:15.987842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.987613 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6847869686-72s7x"] Jun 11 15:07:15.990736 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:15.990707 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6847869686-72s7x"] Jun 11 15:07:16.904745 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:16.904024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" event={"ID":"15878bfd-d9db-417e-8122-262f8b8674cd","Type":"ContainerStarted","Data":"9e2b899d4ab5c90ec8cfd7cc8aaea11fbc6b6cfde7e77741fa45a838df955ec6"} Jun 11 15:07:16.904745 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:16.904111 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" event={"ID":"15878bfd-d9db-417e-8122-262f8b8674cd","Type":"ContainerStarted","Data":"52e738806c7ce5b49e34634176fd75a5343476cef6df8401b9bebe37994dac82"} Jun 11 15:07:16.904745 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:16.904159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" event={"ID":"15878bfd-d9db-417e-8122-262f8b8674cd","Type":"ContainerStarted","Data":"b4e5fed4eb2f5c646a08078d75a41139ddf200c6f01b4ce2d6f2bd4845953fa5"} Jun 11 15:07:16.904745 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:16.904216 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:16.909434 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:16.909408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerStarted","Data":"5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5"} Jun 11 15:07:16.930715 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:16.930647 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" podStartSLOduration=10.840780101 podStartE2EDuration="16.930617613s" totalImagesPullingTime="6.089837512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:16.928240187 +0000 UTC m=+114.045732104" watchObservedRunningTime="2026-06-11 15:07:16.930617613 +0000 UTC m=+114.048109530" Jun 11 15:07:16.963259 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:16.963198 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.55981229 podStartE2EDuration="18.963178135s" totalImagesPullingTime="14.379137167s" totalInitContainerRuntime="24.228678ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:06:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:16.961144732 +0000 UTC m=+114.078636649" watchObservedRunningTime="2026-06-11 15:07:16.963178135 +0000 UTC m=+114.080670052" Jun 11 15:07:17.326755 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:17.326711 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2b35e69-52bb-44c9-b51c-fbe63520df6f" path="/var/lib/kubelet/pods/f2b35e69-52bb-44c9-b51c-fbe63520df6f/volumes" Jun 11 15:07:19.929061 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:19.928757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerStarted","Data":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} Jun 11 15:07:19.929061 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:19.928851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerStarted","Data":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} Jun 11 15:07:19.929061 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:19.928884 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerStarted","Data":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} Jun 11 15:07:19.929061 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:19.928926 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerStarted","Data":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} Jun 11 15:07:20.938526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:20.938485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerStarted","Data":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} Jun 11 15:07:20.939052 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:20.938598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerStarted","Data":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} Jun 11 15:07:20.966690 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:20.966638 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=13.431205618 podStartE2EDuration="17.966620703s" totalImagesPullingTime="4.460595047s" totalInitContainerRuntime="74.820038ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:20.965467178 +0000 UTC m=+118.082959096" watchObservedRunningTime="2026-06-11 15:07:20.966620703 +0000 UTC m=+118.084112620" Jun 11 15:07:22.627336 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:22.627293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:22.627767 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:22.627370 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:22.923342 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:22.923262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9bd8686f8-9kc48" Jun 11 15:07:24.322621 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:24.322589 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:07:26.877334 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:26.877295 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f74bdbc-wh2ks"] Jun 11 15:07:33.089106 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:33.089063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:07:33.091570 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:33.091548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/170a715a-3c6b-4fd8-ac68-5607f70b88ce-metrics-certs\") pod \"network-metrics-daemon-m5v9x\" (UID: \"170a715a-3c6b-4fd8-ac68-5607f70b88ce\") " pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:07:33.130422 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:33.130393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zmrv5\"" Jun 11 15:07:33.138863 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:33.138841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m5v9x" Jun 11 15:07:33.281881 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:33.281857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m5v9x"] Jun 11 15:07:33.284444 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:07:33.284408 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170a715a_3c6b_4fd8_ac68_5607f70b88ce.slice/crio-0a0ed3e2cc48eebc4a4b55573db62a1e5e7cb132ac8fd0d1143b7b2712ce38a4 WatchSource:0}: Error finding container 0a0ed3e2cc48eebc4a4b55573db62a1e5e7cb132ac8fd0d1143b7b2712ce38a4: Status 404 returned error can't find the container with id 0a0ed3e2cc48eebc4a4b55573db62a1e5e7cb132ac8fd0d1143b7b2712ce38a4 Jun 11 15:07:33.726086 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:33.726030 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b6c4b7f45-gbbmf" podUID="e256dc95-2f93-436b-bac4-b0c16aaf3ffa" containerName="console" containerID="cri-o://2534e48575f3c16949ef3c59e7b0c67fcbed1e828d2a19eee506e2a4ccd7c9d5" gracePeriod=15 Jun 11 15:07:34.007217 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.007180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m5v9x" event={"ID":"170a715a-3c6b-4fd8-ac68-5607f70b88ce","Type":"ContainerStarted","Data":"0a0ed3e2cc48eebc4a4b55573db62a1e5e7cb132ac8fd0d1143b7b2712ce38a4"} Jun 11 15:07:34.008524 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.008498 2576 generic.go:356] "Generic (PLEG): container finished" podID="e256dc95-2f93-436b-bac4-b0c16aaf3ffa" containerID="2534e48575f3c16949ef3c59e7b0c67fcbed1e828d2a19eee506e2a4ccd7c9d5" exitCode=0 Jun 11 15:07:34.008655 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.008555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6c4b7f45-gbbmf" event={"ID":"e256dc95-2f93-436b-bac4-b0c16aaf3ffa","Type":"ContainerDied","Data":"2534e48575f3c16949ef3c59e7b0c67fcbed1e828d2a19eee506e2a4ccd7c9d5"} Jun 11 15:07:34.008655 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.008588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6c4b7f45-gbbmf" event={"ID":"e256dc95-2f93-436b-bac4-b0c16aaf3ffa","Type":"ContainerDied","Data":"72e7b73222009a5e4c2525450ef82f2168f704edf523a254478346afbda74972"} Jun 11 15:07:34.008655 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.008609 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72e7b73222009a5e4c2525450ef82f2168f704edf523a254478346afbda74972" Jun 11 15:07:34.032390 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.032363 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:07:34.097750 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.097719 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-oauth-serving-cert\") pod \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " Jun 11 15:07:34.098211 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.097756 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-serving-cert\") pod \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " Jun 11 15:07:34.098211 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.097780 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-service-ca\") pod \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " Jun 11 15:07:34.098211 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.097847 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phsrt\" (UniqueName: \"kubernetes.io/projected/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-kube-api-access-phsrt\") pod \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " Jun 11 15:07:34.098211 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.097872 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-oauth-config\") pod \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " Jun 11 15:07:34.098211 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.097940 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-config\") pod \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\" (UID: \"e256dc95-2f93-436b-bac4-b0c16aaf3ffa\") " Jun 11 15:07:34.098437 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.098212 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e256dc95-2f93-436b-bac4-b0c16aaf3ffa" (UID: "e256dc95-2f93-436b-bac4-b0c16aaf3ffa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:34.098437 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.098219 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-service-ca" (OuterVolumeSpecName: "service-ca") pod "e256dc95-2f93-436b-bac4-b0c16aaf3ffa" (UID: "e256dc95-2f93-436b-bac4-b0c16aaf3ffa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:34.098535 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.098487 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-config" (OuterVolumeSpecName: "console-config") pod "e256dc95-2f93-436b-bac4-b0c16aaf3ffa" (UID: "e256dc95-2f93-436b-bac4-b0c16aaf3ffa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:34.100568 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.100541 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-kube-api-access-phsrt" (OuterVolumeSpecName: "kube-api-access-phsrt") pod "e256dc95-2f93-436b-bac4-b0c16aaf3ffa" (UID: "e256dc95-2f93-436b-bac4-b0c16aaf3ffa"). InnerVolumeSpecName "kube-api-access-phsrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:07:34.100665 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.100555 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e256dc95-2f93-436b-bac4-b0c16aaf3ffa" (UID: "e256dc95-2f93-436b-bac4-b0c16aaf3ffa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:07:34.100665 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.100567 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e256dc95-2f93-436b-bac4-b0c16aaf3ffa" (UID: "e256dc95-2f93-436b-bac4-b0c16aaf3ffa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:07:34.199561 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.199527 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-oauth-serving-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:34.199561 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.199559 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-serving-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:34.199728 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.199576 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-service-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:34.199728 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.199591 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phsrt\" (UniqueName: \"kubernetes.io/projected/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-kube-api-access-phsrt\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:34.199728 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.199607 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-oauth-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:34.199728 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:34.199618 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e256dc95-2f93-436b-bac4-b0c16aaf3ffa-console-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:35.015599 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.015567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m5v9x" event={"ID":"170a715a-3c6b-4fd8-ac68-5607f70b88ce","Type":"ContainerStarted","Data":"7a2df0569967baa52f0255e04347b26cadda3247774394d08e769ccebb405a61"} Jun 11 15:07:35.017508 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.017474 2576 generic.go:356] "Generic (PLEG): container finished" podID="7237fe16-998f-480c-ad41-0708dc5e5bba" containerID="6d736290cf3462ddbdd4daeba39840d229db6dab56645639bd97f10b5e3fdf8a" exitCode=0 Jun 11 15:07:35.017625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.017506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v9gc6" event={"ID":"7237fe16-998f-480c-ad41-0708dc5e5bba","Type":"ContainerDied","Data":"6d736290cf3462ddbdd4daeba39840d229db6dab56645639bd97f10b5e3fdf8a"} Jun 11 15:07:35.017625 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.017615 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6c4b7f45-gbbmf" Jun 11 15:07:35.018225 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.018203 2576 scope.go:117] "RemoveContainer" containerID="6d736290cf3462ddbdd4daeba39840d229db6dab56645639bd97f10b5e3fdf8a" Jun 11 15:07:35.055651 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.055622 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6c4b7f45-gbbmf"] Jun 11 15:07:35.062043 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.062019 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6c4b7f45-gbbmf"] Jun 11 15:07:35.323100 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.323071 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e256dc95-2f93-436b-bac4-b0c16aaf3ffa" path="/var/lib/kubelet/pods/e256dc95-2f93-436b-bac4-b0c16aaf3ffa/volumes" Jun 11 15:07:35.806522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:35.806495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9qkdn_64607fb3-845e-4e7b-8698-7091faa7e8dc/serve-healthcheck-canary/0.log" Jun 11 15:07:36.023542 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:36.023507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m5v9x" event={"ID":"170a715a-3c6b-4fd8-ac68-5607f70b88ce","Type":"ContainerStarted","Data":"40199b345476b769cbe60209dac0dbefc9193689387369e1510e413142411335"} Jun 11 15:07:36.026708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:36.026648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-v9gc6" event={"ID":"7237fe16-998f-480c-ad41-0708dc5e5bba","Type":"ContainerStarted","Data":"c792b3e5d593e3aa2a607bda45ed2a9d107128f9823805233f4d8d2d6edea0a0"} Jun 11 15:07:36.043250 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:36.043204 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m5v9x" podStartSLOduration=131.509205258 podStartE2EDuration="2m13.043190208s" totalImagesPullingTime="1.53398495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:07:36.041710511 +0000 UTC m=+133.159202441" watchObservedRunningTime="2026-06-11 15:07:36.043190208 +0000 UTC m=+133.160682157" Jun 11 15:07:42.633108 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:42.633078 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:42.637095 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:42.637068 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7fcbc4789d-7vl2r" Jun 11 15:07:44.061762 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:44.061730 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b8ddf5b-a7c7-488d-a098-a648061085f3" containerID="506286220eb5ee191cfdc41ee0c32dc7070fd6f210c6b81ce4f5e4bf8aa916a8" exitCode=0 Jun 11 15:07:44.062143 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:44.061825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" event={"ID":"8b8ddf5b-a7c7-488d-a098-a648061085f3","Type":"ContainerDied","Data":"506286220eb5ee191cfdc41ee0c32dc7070fd6f210c6b81ce4f5e4bf8aa916a8"} Jun 11 15:07:44.062187 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:44.062143 2576 scope.go:117] "RemoveContainer" containerID="506286220eb5ee191cfdc41ee0c32dc7070fd6f210c6b81ce4f5e4bf8aa916a8" Jun 11 15:07:45.068459 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:45.068416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9mxvt" event={"ID":"8b8ddf5b-a7c7-488d-a098-a648061085f3","Type":"ContainerStarted","Data":"b616493822caa3cd12243194aa14f17dcd3d59eb3ae32667d3ab96ce9e908ac5"} Jun 11 15:07:51.897582 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:51.897510 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-776f74bdbc-wh2ks" podUID="03e386e0-be48-473d-8fae-3c776bddd53e" containerName="console" containerID="cri-o://058a02bcdf661898c94eb9c93bfcbc21d527be7bf017714ddbe60867c3d5613a" gracePeriod=15 Jun 11 15:07:52.111339 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.111308 2576 generic.go:356] "Generic (PLEG): container finished" podID="03e386e0-be48-473d-8fae-3c776bddd53e" containerID="058a02bcdf661898c94eb9c93bfcbc21d527be7bf017714ddbe60867c3d5613a" exitCode=0 Jun 11 15:07:52.111514 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.111386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f74bdbc-wh2ks" event={"ID":"03e386e0-be48-473d-8fae-3c776bddd53e","Type":"ContainerDied","Data":"058a02bcdf661898c94eb9c93bfcbc21d527be7bf017714ddbe60867c3d5613a"} Jun 11 15:07:52.175939 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.175878 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:52.266388 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266356 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-oauth-config\") pod \"03e386e0-be48-473d-8fae-3c776bddd53e\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " Jun 11 15:07:52.266566 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266409 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-oauth-serving-cert\") pod \"03e386e0-be48-473d-8fae-3c776bddd53e\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " Jun 11 15:07:52.266566 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266426 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qk9t\" (UniqueName: \"kubernetes.io/projected/03e386e0-be48-473d-8fae-3c776bddd53e-kube-api-access-9qk9t\") pod \"03e386e0-be48-473d-8fae-3c776bddd53e\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " Jun 11 15:07:52.266566 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266456 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-console-config\") pod \"03e386e0-be48-473d-8fae-3c776bddd53e\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " Jun 11 15:07:52.266566 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266494 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-trusted-ca-bundle\") pod \"03e386e0-be48-473d-8fae-3c776bddd53e\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " Jun 11 15:07:52.266566 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266535 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-serving-cert\") pod \"03e386e0-be48-473d-8fae-3c776bddd53e\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " Jun 11 15:07:52.266864 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266589 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-service-ca\") pod \"03e386e0-be48-473d-8fae-3c776bddd53e\" (UID: \"03e386e0-be48-473d-8fae-3c776bddd53e\") " Jun 11 15:07:52.266864 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.266824 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03e386e0-be48-473d-8fae-3c776bddd53e" (UID: "03e386e0-be48-473d-8fae-3c776bddd53e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:52.267043 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.267003 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-console-config" (OuterVolumeSpecName: "console-config") pod "03e386e0-be48-473d-8fae-3c776bddd53e" (UID: "03e386e0-be48-473d-8fae-3c776bddd53e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:52.267170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.267104 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-service-ca" (OuterVolumeSpecName: "service-ca") pod "03e386e0-be48-473d-8fae-3c776bddd53e" (UID: "03e386e0-be48-473d-8fae-3c776bddd53e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:52.267396 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.267199 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03e386e0-be48-473d-8fae-3c776bddd53e" (UID: "03e386e0-be48-473d-8fae-3c776bddd53e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:07:52.268878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.268850 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e386e0-be48-473d-8fae-3c776bddd53e-kube-api-access-9qk9t" (OuterVolumeSpecName: "kube-api-access-9qk9t") pod "03e386e0-be48-473d-8fae-3c776bddd53e" (UID: "03e386e0-be48-473d-8fae-3c776bddd53e"). InnerVolumeSpecName "kube-api-access-9qk9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:07:52.268962 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.268898 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03e386e0-be48-473d-8fae-3c776bddd53e" (UID: "03e386e0-be48-473d-8fae-3c776bddd53e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:07:52.269001 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.268958 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03e386e0-be48-473d-8fae-3c776bddd53e" (UID: "03e386e0-be48-473d-8fae-3c776bddd53e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:07:52.367857 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.367818 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-service-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:52.367857 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.367850 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-oauth-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:52.368056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.367868 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-oauth-serving-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:52.368056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.367881 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qk9t\" (UniqueName: \"kubernetes.io/projected/03e386e0-be48-473d-8fae-3c776bddd53e-kube-api-access-9qk9t\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:52.368056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.367891 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-console-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:52.368056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.367902 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e386e0-be48-473d-8fae-3c776bddd53e-trusted-ca-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:52.368056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:52.367916 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03e386e0-be48-473d-8fae-3c776bddd53e-console-serving-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:07:53.117410 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:53.117384 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-776f74bdbc-wh2ks" Jun 11 15:07:53.117410 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:53.117401 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-776f74bdbc-wh2ks" event={"ID":"03e386e0-be48-473d-8fae-3c776bddd53e","Type":"ContainerDied","Data":"2c2b7171ac3ddb316741991e1fff1743c66d0f85237a61b7d3719fd0fedea957"} Jun 11 15:07:53.118022 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:53.117460 2576 scope.go:117] "RemoveContainer" containerID="058a02bcdf661898c94eb9c93bfcbc21d527be7bf017714ddbe60867c3d5613a" Jun 11 15:07:53.138811 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:53.138778 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-776f74bdbc-wh2ks"] Jun 11 15:07:53.143343 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:53.143321 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-776f74bdbc-wh2ks"] Jun 11 15:07:53.322442 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:07:53.322407 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e386e0-be48-473d-8fae-3c776bddd53e" path="/var/lib/kubelet/pods/03e386e0-be48-473d-8fae-3c776bddd53e/volumes" Jun 11 15:08:04.322868 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:04.322832 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:04.377697 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:04.377667 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:05.189232 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:05.189207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:18.210337 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:18.210293 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:08:18.210897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:18.210632 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="alertmanager" containerID="cri-o://08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2" gracePeriod=120 Jun 11 15:08:18.210897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:18.210740 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-metric" containerID="cri-o://e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc" gracePeriod=120 Jun 11 15:08:18.210897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:18.210769 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="config-reloader" containerID="cri-o://8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2" gracePeriod=120 Jun 11 15:08:18.210897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:18.210739 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-web" containerID="cri-o://4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006" gracePeriod=120 Jun 11 15:08:18.210897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:18.210874 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy" containerID="cri-o://88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd" gracePeriod=120 Jun 11 15:08:18.211227 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:18.210815 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="prom-label-proxy" containerID="cri-o://5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5" gracePeriod=120 Jun 11 15:08:19.238578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238548 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerID="5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5" exitCode=0 Jun 11 15:08:19.238578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238571 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerID="e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc" exitCode=0 Jun 11 15:08:19.238578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238576 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerID="88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd" exitCode=0 Jun 11 15:08:19.238578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238582 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerID="8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2" exitCode=0 Jun 11 15:08:19.238578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238587 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerID="08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2" exitCode=0 Jun 11 15:08:19.239083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5"} Jun 11 15:08:19.239083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc"} Jun 11 15:08:19.239083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd"} Jun 11 15:08:19.239083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2"} Jun 11 15:08:19.239083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.238761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2"} Jun 11 15:08:19.459818 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.459774 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:19.507034 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.506947 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-main-tls\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507034 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.506997 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-out\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507034 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-trusted-ca-bundle\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507060 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-cluster-tls-config\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507113 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-main-db\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507146 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-web-config\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507188 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-volume\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507222 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507299 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-metrics-client-ca\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507332 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507398 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptcpj\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-kube-api-access-ptcpj\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507438 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-tls-assets\") pod \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\" (UID: \"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c\") " Jun 11 15:08:19.507578 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507469 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:19.507919 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507699 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.507975 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507915 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:08:19.508209 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.507786 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:19.510171 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.510135 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-out" (OuterVolumeSpecName: "config-out") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:08:19.511501 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.511462 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-kube-api-access-ptcpj" (OuterVolumeSpecName: "kube-api-access-ptcpj") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "kube-api-access-ptcpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:19.511873 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.511833 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:19.511982 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.511878 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:19.511982 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.511907 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:19.512875 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.512840 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:19.513396 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.513365 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:19.513489 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.513421 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-volume" (OuterVolumeSpecName: "config-volume") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:19.518124 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.518043 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:19.526669 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.526639 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-web-config" (OuterVolumeSpecName: "web-config") pod "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" (UID: "dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:19.608164 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608126 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-tls-assets\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608164 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608157 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-main-tls\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608164 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608167 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-out\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608164 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608176 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-cluster-tls-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608193 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-alertmanager-main-db\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608205 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-web-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608213 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-config-volume\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608222 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608230 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608238 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-metrics-client-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608247 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:19.608441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:19.608255 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptcpj\" (UniqueName: \"kubernetes.io/projected/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c-kube-api-access-ptcpj\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:20.246412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.246378 2576 generic.go:356] "Generic (PLEG): container finished" podID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerID="4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006" exitCode=0 Jun 11 15:08:20.246782 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.246460 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.246782 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.246453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006"} Jun 11 15:08:20.246782 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.246608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c","Type":"ContainerDied","Data":"beddf468337e4192b80ef5f9582da31ec6859ea7a318ed9cb0b3efe08be352b1"} Jun 11 15:08:20.246782 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.246643 2576 scope.go:117] "RemoveContainer" containerID="5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5" Jun 11 15:08:20.256914 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.256421 2576 scope.go:117] "RemoveContainer" containerID="e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc" Jun 11 15:08:20.265847 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.265815 2576 scope.go:117] "RemoveContainer" containerID="88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd" Jun 11 15:08:20.274163 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.274137 2576 scope.go:117] "RemoveContainer" containerID="4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006" Jun 11 15:08:20.274669 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.274642 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:08:20.279697 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.279664 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:08:20.285484 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.285208 2576 scope.go:117] "RemoveContainer" containerID="8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2" Jun 11 15:08:20.293377 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.293349 2576 scope.go:117] "RemoveContainer" containerID="08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2" Jun 11 15:08:20.301117 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.301098 2576 scope.go:117] "RemoveContainer" containerID="942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d" Jun 11 15:08:20.309146 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.309125 2576 scope.go:117] "RemoveContainer" containerID="5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5" Jun 11 15:08:20.309438 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:20.309419 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5\": container with ID starting with 5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5 not found: ID does not exist" containerID="5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5" Jun 11 15:08:20.309489 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.309455 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5"} err="failed to get container status \"5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5\": rpc error: code = NotFound desc = could not find container \"5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5\": container with ID starting with 5dcf0e63aa2af99741750a721d2850e11a7785f889dcc4fd042d8dbd398768c5 not found: ID does not exist" Jun 11 15:08:20.309489 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.309477 2576 scope.go:117] "RemoveContainer" containerID="e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc" Jun 11 15:08:20.309757 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:20.309738 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc\": container with ID starting with e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc not found: ID does not exist" containerID="e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc" Jun 11 15:08:20.309856 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.309767 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc"} err="failed to get container status \"e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc\": rpc error: code = NotFound desc = could not find container \"e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc\": container with ID starting with e2280fc8330d3712f5696703f1aad4bef560290c9301093a3854ee2d344185cc not found: ID does not exist" Jun 11 15:08:20.309856 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.309793 2576 scope.go:117] "RemoveContainer" containerID="88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd" Jun 11 15:08:20.310049 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:20.310032 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd\": container with ID starting with 88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd not found: ID does not exist" containerID="88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd" Jun 11 15:08:20.310088 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310054 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd"} err="failed to get container status \"88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd\": rpc error: code = NotFound desc = could not find container \"88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd\": container with ID starting with 88519c461a22f22f9f13e0fa64aaae9ef41ae921a88afa48063bbe4990ff13dd not found: ID does not exist" Jun 11 15:08:20.310088 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310068 2576 scope.go:117] "RemoveContainer" containerID="4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006" Jun 11 15:08:20.310284 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:20.310262 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006\": container with ID starting with 4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006 not found: ID does not exist" containerID="4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006" Jun 11 15:08:20.310328 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310291 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006"} err="failed to get container status \"4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006\": rpc error: code = NotFound desc = could not find container \"4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006\": container with ID starting with 4ba9bf5f6b2c57719e54a4815ed8bdcb5ce4d7ed5dec140fc8525789aca26006 not found: ID does not exist" Jun 11 15:08:20.310328 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310306 2576 scope.go:117] "RemoveContainer" containerID="8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2" Jun 11 15:08:20.310537 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:20.310519 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2\": container with ID starting with 8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2 not found: ID does not exist" containerID="8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2" Jun 11 15:08:20.310597 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310544 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2"} err="failed to get container status \"8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2\": rpc error: code = NotFound desc = could not find container \"8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2\": container with ID starting with 8812ce17ad07fc093233c5120874386e444815737b1b185673534fb747bcece2 not found: ID does not exist" Jun 11 15:08:20.310597 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310562 2576 scope.go:117] "RemoveContainer" containerID="08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2" Jun 11 15:08:20.310765 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:20.310745 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2\": container with ID starting with 08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2 not found: ID does not exist" containerID="08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2" Jun 11 15:08:20.310831 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310769 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2"} err="failed to get container status \"08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2\": rpc error: code = NotFound desc = could not find container \"08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2\": container with ID starting with 08e36d90a2598e3eaca90312190407bf44eec4e079d58952013622fa15a3bfe2 not found: ID does not exist" Jun 11 15:08:20.310831 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310781 2576 scope.go:117] "RemoveContainer" containerID="942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d" Jun 11 15:08:20.310985 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:20.310966 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d\": container with ID starting with 942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d not found: ID does not exist" containerID="942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d" Jun 11 15:08:20.311040 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.310992 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d"} err="failed to get container status \"942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d\": rpc error: code = NotFound desc = could not find container \"942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d\": container with ID starting with 942e692e8c74e2c5e7e151485f636aff6ae6f823d49cbd0b8b930649f6680f2d not found: ID does not exist" Jun 11 15:08:20.319207 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319182 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:08:20.319537 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319524 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="prom-label-proxy" Jun 11 15:08:20.319579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319539 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="prom-label-proxy" Jun 11 15:08:20.319579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319551 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-web" Jun 11 15:08:20.319579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319556 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-web" Jun 11 15:08:20.319579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319562 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-metric" Jun 11 15:08:20.319579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319567 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-metric" Jun 11 15:08:20.319579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319574 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e256dc95-2f93-436b-bac4-b0c16aaf3ffa" containerName="console" Jun 11 15:08:20.319579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319579 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e256dc95-2f93-436b-bac4-b0c16aaf3ffa" containerName="console" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319591 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b35e69-52bb-44c9-b51c-fbe63520df6f" containerName="registry" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319596 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b35e69-52bb-44c9-b51c-fbe63520df6f" containerName="registry" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319602 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319606 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319614 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="config-reloader" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319619 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="config-reloader" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319627 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="alertmanager" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319632 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="alertmanager" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319639 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="init-config-reloader" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319643 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="init-config-reloader" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319650 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e386e0-be48-473d-8fae-3c776bddd53e" containerName="console" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319655 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e386e0-be48-473d-8fae-3c776bddd53e" containerName="console" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319703 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-web" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319711 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e386e0-be48-473d-8fae-3c776bddd53e" containerName="console" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319717 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2b35e69-52bb-44c9-b51c-fbe63520df6f" containerName="registry" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319722 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e256dc95-2f93-436b-bac4-b0c16aaf3ffa" containerName="console" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319729 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="alertmanager" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319734 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="prom-label-proxy" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319740 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319745 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="kube-rbac-proxy-metric" Jun 11 15:08:20.319779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.319750 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" containerName="config-reloader" Jun 11 15:08:20.324207 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.324180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.329721 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.329690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:08:20.329841 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.329690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:08:20.331440 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.331417 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:08:20.331562 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.331484 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:08:20.331562 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.331482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:08:20.331562 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.331532 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:08:20.331562 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.331551 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:08:20.332083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.332063 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:08:20.332171 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.332083 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-csrkm\"" Jun 11 15:08:20.339573 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.339549 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:08:20.345932 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.345901 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:08:20.414554 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-web-config\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414554 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414758 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414758 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414758 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414758 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-config-out\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpdzp\" (UniqueName: \"kubernetes.io/projected/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-kube-api-access-wpdzp\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.414933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.415083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.415083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.414979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515427 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515560 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515560 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-web-config\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515560 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515560 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515776 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515776 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515776 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-config-out\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515776 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515776 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515776 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.515776 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpdzp\" (UniqueName: \"kubernetes.io/projected/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-kube-api-access-wpdzp\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.516156 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.515794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.516156 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.516077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.516446 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.516411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.516691 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.516658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519093 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.518937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519093 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.519006 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-web-config\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519093 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.519034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519292 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.519221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519353 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.519329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519526 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.519503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-config-out\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519589 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.519542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.519589 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.519550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.520991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.520973 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.524182 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.524161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpdzp\" (UniqueName: \"kubernetes.io/projected/ce59895b-a6cc-448e-93dc-ffc7bcc27c8d-kube-api-access-wpdzp\") pod \"alertmanager-main-0\" (UID: \"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.634387 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.634336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:08:20.782063 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:20.781974 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:08:20.785076 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:08:20.785049 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce59895b_a6cc_448e_93dc_ffc7bcc27c8d.slice/crio-e8be6c59d30869e0e9c608d18110e4784e8979a00f932d9164002b60cfc18309 WatchSource:0}: Error finding container e8be6c59d30869e0e9c608d18110e4784e8979a00f932d9164002b60cfc18309: Status 404 returned error can't find the container with id e8be6c59d30869e0e9c608d18110e4784e8979a00f932d9164002b60cfc18309 Jun 11 15:08:21.254286 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:21.254202 2576 generic.go:356] "Generic (PLEG): container finished" podID="ce59895b-a6cc-448e-93dc-ffc7bcc27c8d" containerID="0a131b7e87770ccdd6b4f9457d7e8d88a86f9ba68c2dcb3e316337738659e3f2" exitCode=0 Jun 11 15:08:21.254286 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:21.254266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerDied","Data":"0a131b7e87770ccdd6b4f9457d7e8d88a86f9ba68c2dcb3e316337738659e3f2"} Jun 11 15:08:21.254835 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:21.254323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerStarted","Data":"e8be6c59d30869e0e9c608d18110e4784e8979a00f932d9164002b60cfc18309"} Jun 11 15:08:21.323916 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:21.323889 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c" path="/var/lib/kubelet/pods/dc1a5b8e-1943-44a2-a8fd-8386c20a2a0c/volumes" Jun 11 15:08:22.261583 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.261548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerStarted","Data":"bb1e3aa5049ea20bfc750de128e0599e883025e1cf11d6c13b5250a7402e690b"} Jun 11 15:08:22.261993 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.261627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerStarted","Data":"cc9b2b7b83c3be544ed2513771c1cde9e2f1d4ca6dd183cbe2310791d6a6dab1"} Jun 11 15:08:22.261993 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.261684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerStarted","Data":"81746fc05fb2e4c91f44f9e1d76c6bbb39b0a34e8c84c99c38f9a63e26bbd632"} Jun 11 15:08:22.261993 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.261724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerStarted","Data":"ae0514dc626d1b6ee3388928544a8c3ef6a34947b5ba24be17bbe6936ae398e9"} Jun 11 15:08:22.261993 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.261758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerStarted","Data":"188f2532c08e62c0bed562a796ee580c6bb20ab038e6c45526c08a7240e27965"} Jun 11 15:08:22.261993 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.261792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce59895b-a6cc-448e-93dc-ffc7bcc27c8d","Type":"ContainerStarted","Data":"071f0dbaa043b916b5a121e096f56c79a9e1f3fb956227d46d5ac07b59711e42"} Jun 11 15:08:22.298128 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.298059 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.280265722 podStartE2EDuration="2.298036401s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.770679ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:08:22.295791289 +0000 UTC m=+179.413283207" watchObservedRunningTime="2026-06-11 15:08:22.298036401 +0000 UTC m=+179.415528319" Jun 11 15:08:22.488673 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.488638 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:08:22.489064 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.489027 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="prometheus" containerID="cri-o://6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" gracePeriod=600 Jun 11 15:08:22.489064 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.489035 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy" containerID="cri-o://463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" gracePeriod=600 Jun 11 15:08:22.489064 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.489047 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="thanos-sidecar" containerID="cri-o://e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" gracePeriod=600 Jun 11 15:08:22.489300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.489077 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" gracePeriod=600 Jun 11 15:08:22.489300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.489034 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="config-reloader" containerID="cri-o://8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" gracePeriod=600 Jun 11 15:08:22.489300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.489037 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-web" containerID="cri-o://62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" gracePeriod=600 Jun 11 15:08:22.737942 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.737915 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:22.839546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839447 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-metrics-client-certs\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839500 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-2\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839521 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-trusted-ca-bundle\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839542 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-web-config\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839580 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-db\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839695 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839747 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839781 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-grpc-tls\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839838 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqz6q\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-kube-api-access-pqz6q\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.839909 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839872 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-kubelet-serving-ca-bundle\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839918 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-tls-assets\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839925 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839951 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-metrics-client-ca\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839981 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-tls\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.839981 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840011 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-1\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840034 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-serving-certs-ca-bundle\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840059 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-0\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840084 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-thanos-prometheus-http-client-file\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840125 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840152 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config-out\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.840223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840183 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-kube-rbac-proxy\") pod \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\" (UID: \"5d68719f-6786-43c7-ab7a-bf0ed43a85f9\") " Jun 11 15:08:22.841004 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840714 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.841004 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.840735 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.841383 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.841351 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.842361 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.842708 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.842863 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.842941 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.843426 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.843640 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config" (OuterVolumeSpecName: "config") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.843775 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.843860 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.844297 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.844322 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.844315 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:08:22.844755 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.844663 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.845004 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.844985 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-kube-api-access-pqz6q" (OuterVolumeSpecName: "kube-api-access-pqz6q") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "kube-api-access-pqz6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:08:22.845426 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.845403 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config-out" (OuterVolumeSpecName: "config-out") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:08:22.845540 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.845525 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.845686 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.845672 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.845777 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.845756 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.855570 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.855536 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-web-config" (OuterVolumeSpecName: "web-config") pod "5d68719f-6786-43c7-ab7a-bf0ed43a85f9" (UID: "5d68719f-6786-43c7-ab7a-bf0ed43a85f9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:08:22.941500 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941461 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941500 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941493 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941500 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941504 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941512 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941522 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941532 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config-out\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941551 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-kube-rbac-proxy\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941560 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-metrics-client-certs\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941569 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-web-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941578 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-prometheus-k8s-db\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941586 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941595 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-config\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941602 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-grpc-tls\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941610 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqz6q\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-kube-api-access-pqz6q\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941618 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941626 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-tls-assets\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941635 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-configmap-metrics-client-ca\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:22.941746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:22.941643 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d68719f-6786-43c7-ab7a-bf0ed43a85f9-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:08:23.270293 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270246 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" exitCode=0 Jun 11 15:08:23.270293 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270277 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" exitCode=0 Jun 11 15:08:23.270293 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270288 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" exitCode=0 Jun 11 15:08:23.270293 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270296 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" exitCode=0 Jun 11 15:08:23.270293 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270305 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" exitCode=0 Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270315 2576 generic.go:356] "Generic (PLEG): container finished" podID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" exitCode=0 Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270320 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270479 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270523 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270540 2576 scope.go:117] "RemoveContainer" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} Jun 11 15:08:23.271007 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.270642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d68719f-6786-43c7-ab7a-bf0ed43a85f9","Type":"ContainerDied","Data":"ddacf65902f2b6751aff6dd5af1ef998b6c860bc4bcc6d01a28529b57ef54ccd"} Jun 11 15:08:23.282627 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.282603 2576 scope.go:117] "RemoveContainer" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.285647 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.285608 2576 kuberuntime_gc.go:392] "Failed to remove container log dead symlink" err="remove /var/log/containers/prometheus-k8s-0_openshift-monitoring_kube-rbac-proxy-463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563.log: no such file or directory" path="/var/log/containers/prometheus-k8s-0_openshift-monitoring_kube-rbac-proxy-463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563.log" Jun 11 15:08:23.301175 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.301157 2576 scope.go:117] "RemoveContainer" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.308602 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.308583 2576 scope.go:117] "RemoveContainer" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.316278 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.316255 2576 scope.go:117] "RemoveContainer" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.324834 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.324785 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:08:23.325039 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.325026 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:08:23.326919 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.326903 2576 scope.go:117] "RemoveContainer" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.335500 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.335479 2576 scope.go:117] "RemoveContainer" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.343288 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.343272 2576 scope.go:117] "RemoveContainer" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.343569 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.343548 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": container with ID starting with 07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442 not found: ID does not exist" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.343635 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.343580 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} err="failed to get container status \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": rpc error: code = NotFound desc = could not find container \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": container with ID starting with 07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442 not found: ID does not exist" Jun 11 15:08:23.343635 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.343598 2576 scope.go:117] "RemoveContainer" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.344389 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.344365 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": container with ID starting with 463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563 not found: ID does not exist" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.344472 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.344396 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} err="failed to get container status \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": rpc error: code = NotFound desc = could not find container \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": container with ID starting with 463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563 not found: ID does not exist" Jun 11 15:08:23.344472 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.344421 2576 scope.go:117] "RemoveContainer" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.344702 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.344684 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": container with ID starting with 62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9 not found: ID does not exist" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.344744 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.344708 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} err="failed to get container status \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": rpc error: code = NotFound desc = could not find container \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": container with ID starting with 62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9 not found: ID does not exist" Jun 11 15:08:23.344744 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.344723 2576 scope.go:117] "RemoveContainer" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.344999 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.344977 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": container with ID starting with e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e not found: ID does not exist" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.345091 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.345001 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} err="failed to get container status \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": rpc error: code = NotFound desc = could not find container \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": container with ID starting with e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e not found: ID does not exist" Jun 11 15:08:23.345091 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.345017 2576 scope.go:117] "RemoveContainer" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.345238 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.345213 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": container with ID starting with 8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a not found: ID does not exist" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.345340 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.345240 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} err="failed to get container status \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": rpc error: code = NotFound desc = could not find container \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": container with ID starting with 8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a not found: ID does not exist" Jun 11 15:08:23.345340 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.345254 2576 scope.go:117] "RemoveContainer" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.345577 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.345530 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": container with ID starting with 6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c not found: ID does not exist" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.345577 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.345565 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} err="failed to get container status \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": rpc error: code = NotFound desc = could not find container \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": container with ID starting with 6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c not found: ID does not exist" Jun 11 15:08:23.345791 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.345587 2576 scope.go:117] "RemoveContainer" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.345982 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:08:23.345956 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": container with ID starting with 815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3 not found: ID does not exist" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.346043 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.345991 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3"} err="failed to get container status \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": rpc error: code = NotFound desc = could not find container \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": container with ID starting with 815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3 not found: ID does not exist" Jun 11 15:08:23.346043 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.346012 2576 scope.go:117] "RemoveContainer" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.346483 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.346455 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} err="failed to get container status \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": rpc error: code = NotFound desc = could not find container \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": container with ID starting with 07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442 not found: ID does not exist" Jun 11 15:08:23.346591 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.346484 2576 scope.go:117] "RemoveContainer" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.346768 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.346749 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} err="failed to get container status \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": rpc error: code = NotFound desc = could not find container \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": container with ID starting with 463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563 not found: ID does not exist" Jun 11 15:08:23.346855 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.346771 2576 scope.go:117] "RemoveContainer" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.347056 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347039 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} err="failed to get container status \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": rpc error: code = NotFound desc = could not find container \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": container with ID starting with 62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9 not found: ID does not exist" Jun 11 15:08:23.347135 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347057 2576 scope.go:117] "RemoveContainer" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.347311 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347294 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} err="failed to get container status \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": rpc error: code = NotFound desc = could not find container \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": container with ID starting with e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e not found: ID does not exist" Jun 11 15:08:23.347356 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347311 2576 scope.go:117] "RemoveContainer" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.347542 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347526 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} err="failed to get container status \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": rpc error: code = NotFound desc = could not find container \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": container with ID starting with 8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a not found: ID does not exist" Jun 11 15:08:23.347596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347542 2576 scope.go:117] "RemoveContainer" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.347632 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347619 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:08:23.347728 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347707 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} err="failed to get container status \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": rpc error: code = NotFound desc = could not find container \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": container with ID starting with 6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c not found: ID does not exist" Jun 11 15:08:23.347795 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347731 2576 scope.go:117] "RemoveContainer" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.347949 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347932 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3"} err="failed to get container status \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": rpc error: code = NotFound desc = could not find container \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": container with ID starting with 815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3 not found: ID does not exist" Jun 11 15:08:23.347996 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347951 2576 scope.go:117] "RemoveContainer" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.347996 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347970 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="thanos-sidecar" Jun 11 15:08:23.347996 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347983 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="thanos-sidecar" Jun 11 15:08:23.347996 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.347995 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-thanos" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348001 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-thanos" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348011 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-web" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348017 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-web" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348041 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="init-config-reloader" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348048 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="init-config-reloader" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348057 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="config-reloader" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348066 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="config-reloader" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348082 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348090 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348099 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="prometheus" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348107 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="prometheus" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348118 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} err="failed to get container status \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": rpc error: code = NotFound desc = could not find container \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": container with ID starting with 07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442 not found: ID does not exist" Jun 11 15:08:23.348136 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348138 2576 scope.go:117] "RemoveContainer" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348183 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-web" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348208 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy-thanos" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348220 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="config-reloader" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348228 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="kube-rbac-proxy" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348238 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="thanos-sidecar" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348244 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" containerName="prometheus" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348383 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} err="failed to get container status \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": rpc error: code = NotFound desc = could not find container \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": container with ID starting with 463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563 not found: ID does not exist" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348398 2576 scope.go:117] "RemoveContainer" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348566 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} err="failed to get container status \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": rpc error: code = NotFound desc = could not find container \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": container with ID starting with 62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9 not found: ID does not exist" Jun 11 15:08:23.348587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348586 2576 scope.go:117] "RemoveContainer" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.349016 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348767 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} err="failed to get container status \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": rpc error: code = NotFound desc = could not find container \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": container with ID starting with e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e not found: ID does not exist" Jun 11 15:08:23.349016 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.348790 2576 scope.go:117] "RemoveContainer" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.351454 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.351434 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} err="failed to get container status \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": rpc error: code = NotFound desc = could not find container \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": container with ID starting with 8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a not found: ID does not exist" Jun 11 15:08:23.351543 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.351456 2576 scope.go:117] "RemoveContainer" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.351679 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.351659 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} err="failed to get container status \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": rpc error: code = NotFound desc = could not find container \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": container with ID starting with 6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c not found: ID does not exist" Jun 11 15:08:23.351679 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.351679 2576 scope.go:117] "RemoveContainer" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.351923 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.351903 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3"} err="failed to get container status \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": rpc error: code = NotFound desc = could not find container \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": container with ID starting with 815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3 not found: ID does not exist" Jun 11 15:08:23.352004 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.351925 2576 scope.go:117] "RemoveContainer" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.352168 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.352145 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} err="failed to get container status \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": rpc error: code = NotFound desc = could not find container \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": container with ID starting with 07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442 not found: ID does not exist" Jun 11 15:08:23.352232 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.352172 2576 scope.go:117] "RemoveContainer" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.352437 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.352414 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} err="failed to get container status \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": rpc error: code = NotFound desc = could not find container \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": container with ID starting with 463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563 not found: ID does not exist" Jun 11 15:08:23.352437 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.352435 2576 scope.go:117] "RemoveContainer" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.352729 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.352701 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} err="failed to get container status \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": rpc error: code = NotFound desc = could not find container \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": container with ID starting with 62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9 not found: ID does not exist" Jun 11 15:08:23.352853 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.352727 2576 scope.go:117] "RemoveContainer" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.353043 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.353014 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} err="failed to get container status \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": rpc error: code = NotFound desc = could not find container \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": container with ID starting with e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e not found: ID does not exist" Jun 11 15:08:23.353043 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.353036 2576 scope.go:117] "RemoveContainer" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.353343 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.353315 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} err="failed to get container status \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": rpc error: code = NotFound desc = could not find container \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": container with ID starting with 8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a not found: ID does not exist" Jun 11 15:08:23.353420 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.353344 2576 scope.go:117] "RemoveContainer" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.353779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.353753 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} err="failed to get container status \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": rpc error: code = NotFound desc = could not find container \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": container with ID starting with 6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c not found: ID does not exist" Jun 11 15:08:23.353779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.353779 2576 scope.go:117] "RemoveContainer" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.354023 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.353994 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3"} err="failed to get container status \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": rpc error: code = NotFound desc = could not find container \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": container with ID starting with 815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3 not found: ID does not exist" Jun 11 15:08:23.354086 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.354024 2576 scope.go:117] "RemoveContainer" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.354233 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.354211 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} err="failed to get container status \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": rpc error: code = NotFound desc = could not find container \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": container with ID starting with 07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442 not found: ID does not exist" Jun 11 15:08:23.354233 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.354227 2576 scope.go:117] "RemoveContainer" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.354407 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.354389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.354480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.354453 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} err="failed to get container status \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": rpc error: code = NotFound desc = could not find container \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": container with ID starting with 463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563 not found: ID does not exist" Jun 11 15:08:23.354525 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.354483 2576 scope.go:117] "RemoveContainer" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.355035 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.354986 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} err="failed to get container status \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": rpc error: code = NotFound desc = could not find container \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": container with ID starting with 62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9 not found: ID does not exist" Jun 11 15:08:23.355127 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.355036 2576 scope.go:117] "RemoveContainer" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.355336 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.355314 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} err="failed to get container status \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": rpc error: code = NotFound desc = could not find container \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": container with ID starting with e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e not found: ID does not exist" Jun 11 15:08:23.355336 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.355336 2576 scope.go:117] "RemoveContainer" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.355590 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.355564 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} err="failed to get container status \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": rpc error: code = NotFound desc = could not find container \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": container with ID starting with 8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a not found: ID does not exist" Jun 11 15:08:23.355643 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.355593 2576 scope.go:117] "RemoveContainer" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.355907 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.355882 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} err="failed to get container status \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": rpc error: code = NotFound desc = could not find container \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": container with ID starting with 6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c not found: ID does not exist" Jun 11 15:08:23.355973 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.355910 2576 scope.go:117] "RemoveContainer" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.356146 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356117 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3"} err="failed to get container status \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": rpc error: code = NotFound desc = could not find container \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": container with ID starting with 815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3 not found: ID does not exist" Jun 11 15:08:23.356146 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356146 2576 scope.go:117] "RemoveContainer" containerID="07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442" Jun 11 15:08:23.356395 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356369 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442"} err="failed to get container status \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": rpc error: code = NotFound desc = could not find container \"07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442\": container with ID starting with 07fa8206e4611b0bbffdace30c69ac4cc31ba13f3c0b412a797c79cfaeaae442 not found: ID does not exist" Jun 11 15:08:23.356460 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356395 2576 scope.go:117] "RemoveContainer" containerID="463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563" Jun 11 15:08:23.356635 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356615 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563"} err="failed to get container status \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": rpc error: code = NotFound desc = could not find container \"463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563\": container with ID starting with 463f61558e47631a13ffb92b363ed0ee450d2b7021ed7b22af62ed940775f563 not found: ID does not exist" Jun 11 15:08:23.356710 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356635 2576 scope.go:117] "RemoveContainer" containerID="62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9" Jun 11 15:08:23.356870 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356846 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9"} err="failed to get container status \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": rpc error: code = NotFound desc = could not find container \"62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9\": container with ID starting with 62da145e37aefbcc45de636ff88453d24b9aa2e3d3b06b5695b5dbcddd26dad9 not found: ID does not exist" Jun 11 15:08:23.356870 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356873 2576 scope.go:117] "RemoveContainer" containerID="e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e" Jun 11 15:08:23.356999 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.356983 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:08:23.357159 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.357129 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e"} err="failed to get container status \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": rpc error: code = NotFound desc = could not find container \"e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e\": container with ID starting with e02f39a101ed8e5a6d00be26c624d6a270bf0503ef23dfc421068f510036bc6e not found: ID does not exist" Jun 11 15:08:23.357159 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.357156 2576 scope.go:117] "RemoveContainer" containerID="8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a" Jun 11 15:08:23.357264 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.357194 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.358535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.358641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.358930 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.358974 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.359272 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.359478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.359501 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.359719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:08:23.360096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.359911 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:08:23.360571 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.360266 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:08:23.360571 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.360324 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a"} err="failed to get container status \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": rpc error: code = NotFound desc = could not find container \"8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a\": container with ID starting with 8fae12e3bc7980b76a2898dbd5021325809762fb0d4539a21cf498b8c3fb608a not found: ID does not exist" Jun 11 15:08:23.360571 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.360357 2576 scope.go:117] "RemoveContainer" containerID="6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c" Jun 11 15:08:23.360910 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.360887 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c"} err="failed to get container status \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": rpc error: code = NotFound desc = could not find container \"6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c\": container with ID starting with 6291c664df79953bbd349141fcd19a1612c7c8b003616c7d963c0bc99fae993c not found: ID does not exist" Jun 11 15:08:23.361005 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.360919 2576 scope.go:117] "RemoveContainer" containerID="815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3" Jun 11 15:08:23.362694 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.362423 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3"} err="failed to get container status \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": rpc error: code = NotFound desc = could not find container \"815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3\": container with ID starting with 815e2810a31e469440234dff63feef26546345ad794e28de8407ac4258ec28d3 not found: ID does not exist" Jun 11 15:08:23.362966 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.362943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7ptxx\"" Jun 11 15:08:23.363038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.362977 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4q475kkog38mq\"" Jun 11 15:08:23.365645 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.364669 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:08:23.368222 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.368172 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:08:23.371083 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.371058 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:08:23.444732 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.444732 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.444991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.444991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9grsp\" (UniqueName: \"kubernetes.io/projected/b54d0b7a-be19-4fb9-bb6a-650035c75657-kube-api-access-9grsp\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.444991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-web-config\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.444991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.444991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.444991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b54d0b7a-be19-4fb9-bb6a-650035c75657-config-out\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.444996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b54d0b7a-be19-4fb9-bb6a-650035c75657-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445014 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-config\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.445412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.445297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546395 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546395 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546706 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546766 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-config\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546868 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546924 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546972 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.546972 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.546945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547079 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547132 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547132 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547226 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547226 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547226 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9grsp\" (UniqueName: \"kubernetes.io/projected/b54d0b7a-be19-4fb9-bb6a-650035c75657-kube-api-access-9grsp\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-web-config\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547565 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b54d0b7a-be19-4fb9-bb6a-650035c75657-config-out\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547565 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b54d0b7a-be19-4fb9-bb6a-650035c75657-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547565 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547565 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547565 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.547893 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.547744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.548470 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.548443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.550423 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.550395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.550531 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.550513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.550821 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.550767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.550913 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.550773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-config\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.551402 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.551154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.551402 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.551362 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b54d0b7a-be19-4fb9-bb6a-650035c75657-config-out\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.551546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.551519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b54d0b7a-be19-4fb9-bb6a-650035c75657-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.552247 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.552218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.552620 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.552595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b54d0b7a-be19-4fb9-bb6a-650035c75657-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.552728 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.552711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-web-config\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.553388 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.553367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.553653 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.553636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b54d0b7a-be19-4fb9-bb6a-650035c75657-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.556522 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.556503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9grsp\" (UniqueName: \"kubernetes.io/projected/b54d0b7a-be19-4fb9-bb6a-650035c75657-kube-api-access-9grsp\") pod \"prometheus-k8s-0\" (UID: \"b54d0b7a-be19-4fb9-bb6a-650035c75657\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.670445 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.670408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:08:23.817353 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:23.817269 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:08:23.821738 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:08:23.821704 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54d0b7a_be19_4fb9_bb6a_650035c75657.slice/crio-f1a929f2bf58c7ec3e1440237cf80be5221058b0f46e8fc8b92c917a7eef3c80 WatchSource:0}: Error finding container f1a929f2bf58c7ec3e1440237cf80be5221058b0f46e8fc8b92c917a7eef3c80: Status 404 returned error can't find the container with id f1a929f2bf58c7ec3e1440237cf80be5221058b0f46e8fc8b92c917a7eef3c80 Jun 11 15:08:24.275770 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:24.275737 2576 generic.go:356] "Generic (PLEG): container finished" podID="b54d0b7a-be19-4fb9-bb6a-650035c75657" containerID="ba0abce0f581524bcd6edfc353ff4cbab14145f3f78ce47a12f0e84421bbb90c" exitCode=0 Jun 11 15:08:24.276239 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:24.275833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerDied","Data":"ba0abce0f581524bcd6edfc353ff4cbab14145f3f78ce47a12f0e84421bbb90c"} Jun 11 15:08:24.276239 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:24.275894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerStarted","Data":"f1a929f2bf58c7ec3e1440237cf80be5221058b0f46e8fc8b92c917a7eef3c80"} Jun 11 15:08:25.285588 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.285551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerStarted","Data":"a05d1add3e12c3dbf4378eb981730c5cf917c2bc26ec2a4a70cf42f2b2426169"} Jun 11 15:08:25.285974 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.285672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerStarted","Data":"b0541165acb9e41e8326f41d57b179394d6d533243a9dbdc5d0cc56450b4218e"} Jun 11 15:08:25.285974 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.285713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerStarted","Data":"9ccb9433bea97b917379f3ccb4425dc694318f08e8ecc3359d06e24587036996"} Jun 11 15:08:25.285974 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.285756 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerStarted","Data":"573f13ccd1a02a69f4dc5edb0c4f2420c90f352728a8f1f5e4364a4202665aad"} Jun 11 15:08:25.285974 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.285794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerStarted","Data":"cb90985b336d412c08c614ad703aac5986d0d74862ccb7353c0dc931770329ec"} Jun 11 15:08:25.285974 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.285876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b54d0b7a-be19-4fb9-bb6a-650035c75657","Type":"ContainerStarted","Data":"06c35d87de0912142c25139841b320cf29f2479ff7ae52a91d54607fe962d0a0"} Jun 11 15:08:25.314089 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.314027 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.29418836 podStartE2EDuration="2.314009294s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.820934ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:08:25.311263807 +0000 UTC m=+182.428755725" watchObservedRunningTime="2026-06-11 15:08:25.314009294 +0000 UTC m=+182.431501210" Jun 11 15:08:25.323081 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:25.323049 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d68719f-6786-43c7-ab7a-bf0ed43a85f9" path="/var/lib/kubelet/pods/5d68719f-6786-43c7-ab7a-bf0ed43a85f9/volumes" Jun 11 15:08:28.670874 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:08:28.670833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:09:23.671727 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:23.671635 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:09:23.688399 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:23.688372 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:09:24.553674 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:24.553649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:09:46.358984 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.358909 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8"] Jun 11 15:09:46.362329 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.362310 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.365741 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.365713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 15:09:46.365741 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.365723 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-k5sqd\"" Jun 11 15:09:46.366252 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.366230 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 15:09:46.382251 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.382227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8"] Jun 11 15:09:46.385168 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.385149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t9f8\" (UniqueName: \"kubernetes.io/projected/772fc0c8-f62b-491f-8c60-5f518412c147-kube-api-access-8t9f8\") pod \"cert-manager-webhook-7dc76cbb94-b4tb8\" (UID: \"772fc0c8-f62b-491f-8c60-5f518412c147\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.385257 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.385243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772fc0c8-f62b-491f-8c60-5f518412c147-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-b4tb8\" (UID: \"772fc0c8-f62b-491f-8c60-5f518412c147\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.486243 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.486208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772fc0c8-f62b-491f-8c60-5f518412c147-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-b4tb8\" (UID: \"772fc0c8-f62b-491f-8c60-5f518412c147\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.486424 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.486266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t9f8\" (UniqueName: \"kubernetes.io/projected/772fc0c8-f62b-491f-8c60-5f518412c147-kube-api-access-8t9f8\") pod \"cert-manager-webhook-7dc76cbb94-b4tb8\" (UID: \"772fc0c8-f62b-491f-8c60-5f518412c147\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.496468 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.496442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772fc0c8-f62b-491f-8c60-5f518412c147-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-b4tb8\" (UID: \"772fc0c8-f62b-491f-8c60-5f518412c147\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.496622 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.496605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t9f8\" (UniqueName: \"kubernetes.io/projected/772fc0c8-f62b-491f-8c60-5f518412c147-kube-api-access-8t9f8\") pod \"cert-manager-webhook-7dc76cbb94-b4tb8\" (UID: \"772fc0c8-f62b-491f-8c60-5f518412c147\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.688011 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.687919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:46.869908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:46.869880 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8"] Jun 11 15:09:46.873318 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:09:46.873292 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod772fc0c8_f62b_491f_8c60_5f518412c147.slice/crio-e67671a7ec3e70a8b9a59a8bbca43c9cf2396d3bc7fb68a7972405365c1e3575 WatchSource:0}: Error finding container e67671a7ec3e70a8b9a59a8bbca43c9cf2396d3bc7fb68a7972405365c1e3575: Status 404 returned error can't find the container with id e67671a7ec3e70a8b9a59a8bbca43c9cf2396d3bc7fb68a7972405365c1e3575 Jun 11 15:09:47.633087 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:47.633055 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" event={"ID":"772fc0c8-f62b-491f-8c60-5f518412c147","Type":"ContainerStarted","Data":"e67671a7ec3e70a8b9a59a8bbca43c9cf2396d3bc7fb68a7972405365c1e3575"} Jun 11 15:09:50.648602 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:50.648564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" event={"ID":"772fc0c8-f62b-491f-8c60-5f518412c147","Type":"ContainerStarted","Data":"7df177591378339c8be21e3752e23d7899ff547b137f3d4b300ade7ff10a7b5c"} Jun 11 15:09:50.648992 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:50.648641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:50.687696 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:50.687647 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" podStartSLOduration=1.5928776199999999 podStartE2EDuration="4.68763282s" totalImagesPullingTime="3.0947552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:50.686111034 +0000 UTC m=+267.803602951" watchObservedRunningTime="2026-06-11 15:09:50.68763282 +0000 UTC m=+267.805124736" Jun 11 15:09:56.654111 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:56.654080 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-b4tb8" Jun 11 15:09:58.181023 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.180990 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd"] Jun 11 15:09:58.184078 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.184059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.186763 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.186742 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 15:09:58.186904 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.186882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qhvqm\"" Jun 11 15:09:58.186988 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.186973 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:09:58.198049 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.198015 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd"] Jun 11 15:09:58.298682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.298649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0501aeec-745a-4641-892b-9e37d864388f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-stpzd\" (UID: \"0501aeec-745a-4641-892b-9e37d864388f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.298682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.298688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w62lt\" (UniqueName: \"kubernetes.io/projected/0501aeec-745a-4641-892b-9e37d864388f-kube-api-access-w62lt\") pod \"openshift-lws-operator-fd8ccff4c-stpzd\" (UID: \"0501aeec-745a-4641-892b-9e37d864388f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.399912 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.399879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0501aeec-745a-4641-892b-9e37d864388f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-stpzd\" (UID: \"0501aeec-745a-4641-892b-9e37d864388f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.400101 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.399914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w62lt\" (UniqueName: \"kubernetes.io/projected/0501aeec-745a-4641-892b-9e37d864388f-kube-api-access-w62lt\") pod \"openshift-lws-operator-fd8ccff4c-stpzd\" (UID: \"0501aeec-745a-4641-892b-9e37d864388f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.400331 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.400308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0501aeec-745a-4641-892b-9e37d864388f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-stpzd\" (UID: \"0501aeec-745a-4641-892b-9e37d864388f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.412837 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.412792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w62lt\" (UniqueName: \"kubernetes.io/projected/0501aeec-745a-4641-892b-9e37d864388f-kube-api-access-w62lt\") pod \"openshift-lws-operator-fd8ccff4c-stpzd\" (UID: \"0501aeec-745a-4641-892b-9e37d864388f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.494116 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.494038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" Jun 11 15:09:58.630224 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.630196 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd"] Jun 11 15:09:58.632831 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:09:58.632785 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0501aeec_745a_4641_892b_9e37d864388f.slice/crio-66da4a714df64461fadc87f20f838900cafa358599bdf7bfcde0efbcace76662 WatchSource:0}: Error finding container 66da4a714df64461fadc87f20f838900cafa358599bdf7bfcde0efbcace76662: Status 404 returned error can't find the container with id 66da4a714df64461fadc87f20f838900cafa358599bdf7bfcde0efbcace76662 Jun 11 15:09:58.682335 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:09:58.682306 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" event={"ID":"0501aeec-745a-4641-892b-9e37d864388f","Type":"ContainerStarted","Data":"66da4a714df64461fadc87f20f838900cafa358599bdf7bfcde0efbcace76662"} Jun 11 15:10:01.700602 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:01.700507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" event={"ID":"0501aeec-745a-4641-892b-9e37d864388f","Type":"ContainerStarted","Data":"0c43ac40c2181121013ae96f78f7d5f2b183e82cd7ecc8a7b6a871226df27e4b"} Jun 11 15:10:01.730316 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:01.730268 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-stpzd" podStartSLOduration=1.016538592 podStartE2EDuration="3.730252411s" totalImagesPullingTime="2.713713819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:10:01.729479439 +0000 UTC m=+278.846971364" watchObservedRunningTime="2026-06-11 15:10:01.730252411 +0000 UTC m=+278.847744327" Jun 11 15:10:17.418125 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.418091 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z"] Jun 11 15:10:17.422149 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.422128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.451402 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.451367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 15:10:17.451572 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.451547 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 15:10:17.453560 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.453539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 15:10:17.469483 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.469448 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bbmwp\"" Jun 11 15:10:17.471665 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.471643 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z"] Jun 11 15:10:17.569593 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.569558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-metrics-cert\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.569766 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.569637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-cert\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.569766 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.569698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9wd5\" (UniqueName: \"kubernetes.io/projected/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-kube-api-access-t9wd5\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.569766 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.569750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-manager-config\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.670679 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.670604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-metrics-cert\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.670679 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.670664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-cert\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.670962 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.670710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9wd5\" (UniqueName: \"kubernetes.io/projected/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-kube-api-access-t9wd5\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.670962 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.670730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-manager-config\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.671332 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.671309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-manager-config\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.673328 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.673303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-cert\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.673444 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.673427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-metrics-cert\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.680897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.680871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9wd5\" (UniqueName: \"kubernetes.io/projected/0cc669df-097c-46ca-804a-f2ca0c0cdbaa-kube-api-access-t9wd5\") pod \"lws-controller-manager-87f58c8fb-6zj2z\" (UID: \"0cc669df-097c-46ca-804a-f2ca0c0cdbaa\") " pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.730811 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.730784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:17.878514 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:17.878491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z"] Jun 11 15:10:17.880922 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:10:17.880891 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc669df_097c_46ca_804a_f2ca0c0cdbaa.slice/crio-577cb5f6319c1cbfd49c0d2a60345d88b08f3c65ecc76a9f3d2d9307142a780f WatchSource:0}: Error finding container 577cb5f6319c1cbfd49c0d2a60345d88b08f3c65ecc76a9f3d2d9307142a780f: Status 404 returned error can't find the container with id 577cb5f6319c1cbfd49c0d2a60345d88b08f3c65ecc76a9f3d2d9307142a780f Jun 11 15:10:18.775702 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:18.775656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" event={"ID":"0cc669df-097c-46ca-804a-f2ca0c0cdbaa","Type":"ContainerStarted","Data":"577cb5f6319c1cbfd49c0d2a60345d88b08f3c65ecc76a9f3d2d9307142a780f"} Jun 11 15:10:20.786672 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:20.786636 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" event={"ID":"0cc669df-097c-46ca-804a-f2ca0c0cdbaa","Type":"ContainerStarted","Data":"70195ab4503f91fdd6a1ab24a4c4c29b63bc1a8c82bbbf81b5df122f60e967af"} Jun 11 15:10:20.787088 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:20.786704 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:21.027140 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:21.027083 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" podStartSLOduration=1.755244434 podStartE2EDuration="4.027066271s" totalImagesPullingTime="2.271821837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:10:21.006631072 +0000 UTC m=+298.124122986" watchObservedRunningTime="2026-06-11 15:10:21.027066271 +0000 UTC m=+298.144558185" Jun 11 15:10:22.546830 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.546325 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f"] Jun 11 15:10:22.550648 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.550623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.553908 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.553881 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wv842\"" Jun 11 15:10:22.554048 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.553924 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 15:10:22.554048 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.553967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 15:10:22.554850 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.554829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 15:10:22.555096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.555078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 15:10:22.568639 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.568613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f"] Jun 11 15:10:22.717595 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.717560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d79e32b-af07-42b1-b2be-15f5732eec1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.717858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.717602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s579b\" (UniqueName: \"kubernetes.io/projected/2d79e32b-af07-42b1-b2be-15f5732eec1b-kube-api-access-s579b\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.717858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.717630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d79e32b-af07-42b1-b2be-15f5732eec1b-manifests\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.717858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.717759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d79e32b-af07-42b1-b2be-15f5732eec1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.717858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.717790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d79e32b-af07-42b1-b2be-15f5732eec1b-tmp\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.819259 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.819174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d79e32b-af07-42b1-b2be-15f5732eec1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.819259 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.819207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s579b\" (UniqueName: \"kubernetes.io/projected/2d79e32b-af07-42b1-b2be-15f5732eec1b-kube-api-access-s579b\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.819259 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.819229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d79e32b-af07-42b1-b2be-15f5732eec1b-manifests\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.819524 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.819314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d79e32b-af07-42b1-b2be-15f5732eec1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.819524 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.819346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d79e32b-af07-42b1-b2be-15f5732eec1b-tmp\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.819742 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.819710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d79e32b-af07-42b1-b2be-15f5732eec1b-manifests\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.821752 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.821727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d79e32b-af07-42b1-b2be-15f5732eec1b-tmp\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.821885 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.821860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d79e32b-af07-42b1-b2be-15f5732eec1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.821936 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.821863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d79e32b-af07-42b1-b2be-15f5732eec1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.848623 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.848594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s579b\" (UniqueName: \"kubernetes.io/projected/2d79e32b-af07-42b1-b2be-15f5732eec1b-kube-api-access-s579b\") pod \"opendatahub-operator-controller-manager-f75ddbfd7-lvx9f\" (UID: \"2d79e32b-af07-42b1-b2be-15f5732eec1b\") " pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:22.861469 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:22.861448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:23.019745 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:23.019715 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f"] Jun 11 15:10:23.022885 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:10:23.022857 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d79e32b_af07_42b1_b2be_15f5732eec1b.slice/crio-60e411e77aeb852ed960855130de712d069dc8636c0cd52fac51d87a3533edac WatchSource:0}: Error finding container 60e411e77aeb852ed960855130de712d069dc8636c0cd52fac51d87a3533edac: Status 404 returned error can't find the container with id 60e411e77aeb852ed960855130de712d069dc8636c0cd52fac51d87a3533edac Jun 11 15:10:23.279614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:23.279586 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 15:10:23.803295 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:23.803255 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" event={"ID":"2d79e32b-af07-42b1-b2be-15f5732eec1b","Type":"ContainerStarted","Data":"60e411e77aeb852ed960855130de712d069dc8636c0cd52fac51d87a3533edac"} Jun 11 15:10:25.813509 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:25.813475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" event={"ID":"2d79e32b-af07-42b1-b2be-15f5732eec1b","Type":"ContainerStarted","Data":"9a192af0c5e46b893e7f51ae778e2f36f1c20fbd90a08407ac244cc4f3e40489"} Jun 11 15:10:26.819747 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:26.819713 2576 generic.go:356] "Generic (PLEG): container finished" podID="2d79e32b-af07-42b1-b2be-15f5732eec1b" containerID="9a192af0c5e46b893e7f51ae778e2f36f1c20fbd90a08407ac244cc4f3e40489" exitCode=0 Jun 11 15:10:26.820185 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:26.819819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" event={"ID":"2d79e32b-af07-42b1-b2be-15f5732eec1b","Type":"ContainerDied","Data":"9a192af0c5e46b893e7f51ae778e2f36f1c20fbd90a08407ac244cc4f3e40489"} Jun 11 15:10:26.820283 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:26.820267 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:10:27.826991 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:27.826960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" event={"ID":"2d79e32b-af07-42b1-b2be-15f5732eec1b","Type":"ContainerStarted","Data":"bff8728125406ba9b86c75509de044457cca27516489c0f1434a92e983de3e67"} Jun 11 15:10:27.827409 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:27.827082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:10:27.892979 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:27.892924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" podStartSLOduration=1.778760432 podStartE2EDuration="5.892907038s" totalImagesPullingTime="3.160664085s" totalInitContainerRuntime="953.482521ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:10:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:10:27.890653797 +0000 UTC m=+305.008145735" watchObservedRunningTime="2026-06-11 15:10:27.892907038 +0000 UTC m=+305.010398955" Jun 11 15:10:31.793656 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:31.793628 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-87f58c8fb-6zj2z" Jun 11 15:10:38.834137 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:10:38.834099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f75ddbfd7-lvx9f" Jun 11 15:11:10.713930 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.713844 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-69669f6f8f-8zcmr"] Jun 11 15:11:10.716320 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.716300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:10.720308 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.720282 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hzxxr\"" Jun 11 15:11:10.720877 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.720849 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 15:11:10.739303 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.739269 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69669f6f8f-8zcmr"] Jun 11 15:11:10.760210 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.760175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk44c\" (UniqueName: \"kubernetes.io/projected/0f9467d7-345e-41ac-92da-58caf5550967-kube-api-access-nk44c\") pod \"dashboard-redirect-69669f6f8f-8zcmr\" (UID: \"0f9467d7-345e-41ac-92da-58caf5550967\") " pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:10.760391 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.760271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f9467d7-345e-41ac-92da-58caf5550967-redirect-config\") pod \"dashboard-redirect-69669f6f8f-8zcmr\" (UID: \"0f9467d7-345e-41ac-92da-58caf5550967\") " pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:10.860726 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.860686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f9467d7-345e-41ac-92da-58caf5550967-redirect-config\") pod \"dashboard-redirect-69669f6f8f-8zcmr\" (UID: \"0f9467d7-345e-41ac-92da-58caf5550967\") " pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:10.860936 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.860756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk44c\" (UniqueName: \"kubernetes.io/projected/0f9467d7-345e-41ac-92da-58caf5550967-kube-api-access-nk44c\") pod \"dashboard-redirect-69669f6f8f-8zcmr\" (UID: \"0f9467d7-345e-41ac-92da-58caf5550967\") " pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:10.861412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.861390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f9467d7-345e-41ac-92da-58caf5550967-redirect-config\") pod \"dashboard-redirect-69669f6f8f-8zcmr\" (UID: \"0f9467d7-345e-41ac-92da-58caf5550967\") " pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:10.877911 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:10.877880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk44c\" (UniqueName: \"kubernetes.io/projected/0f9467d7-345e-41ac-92da-58caf5550967-kube-api-access-nk44c\") pod \"dashboard-redirect-69669f6f8f-8zcmr\" (UID: \"0f9467d7-345e-41ac-92da-58caf5550967\") " pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:11.026484 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:11.026427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" Jun 11 15:11:11.184854 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:11.184794 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69669f6f8f-8zcmr"] Jun 11 15:11:11.194629 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:11:11.194602 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9467d7_345e_41ac_92da_58caf5550967.slice/crio-2cde4ad75aa6b687a850f76070e1429fa1f2be74a87c4b9235ded96a598dd583 WatchSource:0}: Error finding container 2cde4ad75aa6b687a850f76070e1429fa1f2be74a87c4b9235ded96a598dd583: Status 404 returned error can't find the container with id 2cde4ad75aa6b687a850f76070e1429fa1f2be74a87c4b9235ded96a598dd583 Jun 11 15:11:12.041174 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:12.041133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" event={"ID":"0f9467d7-345e-41ac-92da-58caf5550967","Type":"ContainerStarted","Data":"2cde4ad75aa6b687a850f76070e1429fa1f2be74a87c4b9235ded96a598dd583"} Jun 11 15:11:16.065118 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:16.065085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" event={"ID":"0f9467d7-345e-41ac-92da-58caf5550967","Type":"ContainerStarted","Data":"fa67c968d231e25db69c69f04a53beadf83f041f1fb6eba9342815571b49abad"} Jun 11 15:11:16.092396 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:16.092338 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-69669f6f8f-8zcmr" podStartSLOduration=1.613087051 podStartE2EDuration="6.092321998s" totalImagesPullingTime="4.479234947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:16.089163472 +0000 UTC m=+353.206655393" watchObservedRunningTime="2026-06-11 15:11:16.092321998 +0000 UTC m=+353.209813914" Jun 11 15:11:29.824489 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.824451 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s"] Jun 11 15:11:29.828089 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.828065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.830632 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.830608 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:11:29.830971 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.830950 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:11:29.831087 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.831026 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 15:11:29.831087 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.831055 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bnjn2\"" Jun 11 15:11:29.844949 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.844923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s"] Jun 11 15:11:29.941120 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941303 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941303 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941303 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941303 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:29.941447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:29.941400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9g7w\" (UniqueName: \"kubernetes.io/projected/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-kube-api-access-m9g7w\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.042885 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.042832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.042885 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.042882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043130 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.042921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043130 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.042937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043130 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.042954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043130 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9g7w\" (UniqueName: \"kubernetes.io/projected/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-kube-api-access-m9g7w\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043442 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043323 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043624 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.043939 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.044010 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.043984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.045681 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.045662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.045840 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.045821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.060201 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.060168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.060338 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.060294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9g7w\" (UniqueName: \"kubernetes.io/projected/f13ad83a-8355-4f9a-b5e3-ae9c4c13162c-kube-api-access-m9g7w\") pod \"data-science-gateway-data-science-gateway-class-677b9b985557n4s\" (UID: \"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.138876 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.138784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:30.297934 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:30.297911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s"] Jun 11 15:11:30.299283 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:11:30.299250 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13ad83a_8355_4f9a_b5e3_ae9c4c13162c.slice/crio-d80a801c1d028de5e522a192a86a07d5a20b93cd2450e67469fb7bb15d915a38 WatchSource:0}: Error finding container d80a801c1d028de5e522a192a86a07d5a20b93cd2450e67469fb7bb15d915a38: Status 404 returned error can't find the container with id d80a801c1d028de5e522a192a86a07d5a20b93cd2450e67469fb7bb15d915a38 Jun 11 15:11:31.149512 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:31.144198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" event={"ID":"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c","Type":"ContainerStarted","Data":"d80a801c1d028de5e522a192a86a07d5a20b93cd2450e67469fb7bb15d915a38"} Jun 11 15:11:33.285529 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:33.285485 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:11:33.285852 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:33.285574 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:11:33.285852 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:33.285603 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:11:34.161441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:34.161409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" event={"ID":"f13ad83a-8355-4f9a-b5e3-ae9c4c13162c","Type":"ContainerStarted","Data":"3fe44f35c8fad17b292317c3a0b9803cbaf5fca704eb915bc54fa3c8e75fb85e"} Jun 11 15:11:34.187430 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:34.187362 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" podStartSLOduration=2.203610865 podStartE2EDuration="5.187342254s" totalImagesPullingTime="2.983731389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:34.185385965 +0000 UTC m=+371.302877881" watchObservedRunningTime="2026-06-11 15:11:34.187342254 +0000 UTC m=+371.304834171" Jun 11 15:11:35.139158 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:35.139120 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:35.143993 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:35.143967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:35.166496 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:35.166364 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:35.167677 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:35.167657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-677b9b985557n4s" Jun 11 15:11:43.606516 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.606475 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pplf9"] Jun 11 15:11:43.609048 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.609032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" Jun 11 15:11:43.613904 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.613879 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:11:43.614057 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.613889 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gx5nz\"" Jun 11 15:11:43.614057 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.613889 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:11:43.620703 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.620677 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pplf9"] Jun 11 15:11:43.778719 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.778678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc2k8\" (UniqueName: \"kubernetes.io/projected/03f8000e-ffcd-4379-9617-cbffac09197c-kube-api-access-zc2k8\") pod \"kuadrant-operator-catalog-pplf9\" (UID: \"03f8000e-ffcd-4379-9617-cbffac09197c\") " pod="kuadrant-system/kuadrant-operator-catalog-pplf9" Jun 11 15:11:43.879417 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.879329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc2k8\" (UniqueName: \"kubernetes.io/projected/03f8000e-ffcd-4379-9617-cbffac09197c-kube-api-access-zc2k8\") pod \"kuadrant-operator-catalog-pplf9\" (UID: \"03f8000e-ffcd-4379-9617-cbffac09197c\") " pod="kuadrant-system/kuadrant-operator-catalog-pplf9" Jun 11 15:11:43.888568 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.888543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc2k8\" (UniqueName: \"kubernetes.io/projected/03f8000e-ffcd-4379-9617-cbffac09197c-kube-api-access-zc2k8\") pod \"kuadrant-operator-catalog-pplf9\" (UID: \"03f8000e-ffcd-4379-9617-cbffac09197c\") " pod="kuadrant-system/kuadrant-operator-catalog-pplf9" Jun 11 15:11:43.919674 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.919635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" Jun 11 15:11:43.964556 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:43.964520 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pplf9"] Jun 11 15:11:44.056089 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.056063 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pplf9"] Jun 11 15:11:44.058315 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:11:44.058288 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f8000e_ffcd_4379_9617_cbffac09197c.slice/crio-0fc430b379e01cdd0c9f7909229318ad0ec8b0e5bc37f9984af2a5f1b7ce4047 WatchSource:0}: Error finding container 0fc430b379e01cdd0c9f7909229318ad0ec8b0e5bc37f9984af2a5f1b7ce4047: Status 404 returned error can't find the container with id 0fc430b379e01cdd0c9f7909229318ad0ec8b0e5bc37f9984af2a5f1b7ce4047 Jun 11 15:11:44.174926 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.174850 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kdvw9"] Jun 11 15:11:44.177960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.177942 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:44.185614 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.185595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kdvw9"] Jun 11 15:11:44.210640 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.210608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" event={"ID":"03f8000e-ffcd-4379-9617-cbffac09197c","Type":"ContainerStarted","Data":"0fc430b379e01cdd0c9f7909229318ad0ec8b0e5bc37f9984af2a5f1b7ce4047"} Jun 11 15:11:44.283246 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.283207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvfw\" (UniqueName: \"kubernetes.io/projected/012f4241-efba-4079-bbe8-afce24720caa-kube-api-access-ffvfw\") pod \"kuadrant-operator-catalog-kdvw9\" (UID: \"012f4241-efba-4079-bbe8-afce24720caa\") " pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:44.384715 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.384676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvfw\" (UniqueName: \"kubernetes.io/projected/012f4241-efba-4079-bbe8-afce24720caa-kube-api-access-ffvfw\") pod \"kuadrant-operator-catalog-kdvw9\" (UID: \"012f4241-efba-4079-bbe8-afce24720caa\") " pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:44.393724 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.393699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvfw\" (UniqueName: \"kubernetes.io/projected/012f4241-efba-4079-bbe8-afce24720caa-kube-api-access-ffvfw\") pod \"kuadrant-operator-catalog-kdvw9\" (UID: \"012f4241-efba-4079-bbe8-afce24720caa\") " pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:44.488267 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.488189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:44.625033 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:44.625002 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kdvw9"] Jun 11 15:11:44.653198 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:11:44.653155 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012f4241_efba_4079_bbe8_afce24720caa.slice/crio-bcfaee2ca4c51c199189a943697418aa25fb4b4f25c1fda90f70b66b020f3829 WatchSource:0}: Error finding container bcfaee2ca4c51c199189a943697418aa25fb4b4f25c1fda90f70b66b020f3829: Status 404 returned error can't find the container with id bcfaee2ca4c51c199189a943697418aa25fb4b4f25c1fda90f70b66b020f3829 Jun 11 15:11:45.218315 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:45.218267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" event={"ID":"012f4241-efba-4079-bbe8-afce24720caa","Type":"ContainerStarted","Data":"bcfaee2ca4c51c199189a943697418aa25fb4b4f25c1fda90f70b66b020f3829"} Jun 11 15:11:47.230752 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.230715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" event={"ID":"03f8000e-ffcd-4379-9617-cbffac09197c","Type":"ContainerStarted","Data":"f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff"} Jun 11 15:11:47.231282 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.230753 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" podUID="03f8000e-ffcd-4379-9617-cbffac09197c" containerName="registry-server" containerID="cri-o://f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff" gracePeriod=2 Jun 11 15:11:47.232381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.232353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" event={"ID":"012f4241-efba-4079-bbe8-afce24720caa","Type":"ContainerStarted","Data":"1e5c148b5a202580dcaa7bf40e431423fb4d8beeb28c73548bb43d11d3db7836"} Jun 11 15:11:47.246781 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.246731 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" podStartSLOduration=1.8105434489999999 podStartE2EDuration="4.246713007s" totalImagesPullingTime="2.436169558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:47.245450296 +0000 UTC m=+384.362942223" watchObservedRunningTime="2026-06-11 15:11:47.246713007 +0000 UTC m=+384.364204922" Jun 11 15:11:47.263268 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.263216 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" podStartSLOduration=1.425260956 podStartE2EDuration="3.263200017s" totalImagesPullingTime="1.837939061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:47.262162825 +0000 UTC m=+384.379654740" watchObservedRunningTime="2026-06-11 15:11:47.263200017 +0000 UTC m=+384.380691953" Jun 11 15:11:47.501678 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.501604 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" Jun 11 15:11:47.616175 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.616130 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc2k8\" (UniqueName: \"kubernetes.io/projected/03f8000e-ffcd-4379-9617-cbffac09197c-kube-api-access-zc2k8\") pod \"03f8000e-ffcd-4379-9617-cbffac09197c\" (UID: \"03f8000e-ffcd-4379-9617-cbffac09197c\") " Jun 11 15:11:47.618457 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.618426 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03f8000e-ffcd-4379-9617-cbffac09197c-kube-api-access-zc2k8" (OuterVolumeSpecName: "kube-api-access-zc2k8") pod "03f8000e-ffcd-4379-9617-cbffac09197c" (UID: "03f8000e-ffcd-4379-9617-cbffac09197c"). InnerVolumeSpecName "kube-api-access-zc2k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:11:47.716878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:47.716842 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc2k8\" (UniqueName: \"kubernetes.io/projected/03f8000e-ffcd-4379-9617-cbffac09197c-kube-api-access-zc2k8\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:11:48.238069 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.238034 2576 generic.go:356] "Generic (PLEG): container finished" podID="03f8000e-ffcd-4379-9617-cbffac09197c" containerID="f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff" exitCode=0 Jun 11 15:11:48.238069 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.238076 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" Jun 11 15:11:48.238598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.238117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" event={"ID":"03f8000e-ffcd-4379-9617-cbffac09197c","Type":"ContainerDied","Data":"f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff"} Jun 11 15:11:48.238598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.238163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pplf9" event={"ID":"03f8000e-ffcd-4379-9617-cbffac09197c","Type":"ContainerDied","Data":"0fc430b379e01cdd0c9f7909229318ad0ec8b0e5bc37f9984af2a5f1b7ce4047"} Jun 11 15:11:48.238598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.238187 2576 scope.go:117] "RemoveContainer" containerID="f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff" Jun 11 15:11:48.247191 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.247171 2576 scope.go:117] "RemoveContainer" containerID="f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff" Jun 11 15:11:48.247533 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:11:48.247513 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff\": container with ID starting with f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff not found: ID does not exist" containerID="f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff" Jun 11 15:11:48.247582 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.247544 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff"} err="failed to get container status \"f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff\": rpc error: code = NotFound desc = could not find container \"f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff\": container with ID starting with f91f0546123bf76eac3727e0b1615c80a9647e412e52dc53ba5554fde22331ff not found: ID does not exist" Jun 11 15:11:48.261479 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.261444 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pplf9"] Jun 11 15:11:48.266264 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:48.266237 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pplf9"] Jun 11 15:11:49.323638 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:49.323604 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03f8000e-ffcd-4379-9617-cbffac09197c" path="/var/lib/kubelet/pods/03f8000e-ffcd-4379-9617-cbffac09197c/volumes" Jun 11 15:11:54.488631 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:54.488593 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:54.489057 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:54.488661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:54.511274 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:54.511251 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:11:55.295218 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:11:55.295191 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kdvw9" Jun 11 15:12:15.202117 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.202083 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4"] Jun 11 15:12:15.202533 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.202446 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f8000e-ffcd-4379-9617-cbffac09197c" containerName="registry-server" Jun 11 15:12:15.202533 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.202456 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f8000e-ffcd-4379-9617-cbffac09197c" containerName="registry-server" Jun 11 15:12:15.202616 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.202538 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="03f8000e-ffcd-4379-9617-cbffac09197c" containerName="registry-server" Jun 11 15:12:15.208724 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.208692 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" Jun 11 15:12:15.214818 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.214748 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 15:12:15.216252 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.216232 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wfzrq\"" Jun 11 15:12:15.218097 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.218072 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4"] Jun 11 15:12:15.270066 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.270033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfq6k\" (UniqueName: \"kubernetes.io/projected/e4e16959-9d62-4db9-b79a-86d60d777e5f-kube-api-access-jfq6k\") pod \"dns-operator-controller-manager-864dd78c4c-shgw4\" (UID: \"e4e16959-9d62-4db9-b79a-86d60d777e5f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" Jun 11 15:12:15.371197 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.371159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfq6k\" (UniqueName: \"kubernetes.io/projected/e4e16959-9d62-4db9-b79a-86d60d777e5f-kube-api-access-jfq6k\") pod \"dns-operator-controller-manager-864dd78c4c-shgw4\" (UID: \"e4e16959-9d62-4db9-b79a-86d60d777e5f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" Jun 11 15:12:15.386486 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.386457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfq6k\" (UniqueName: \"kubernetes.io/projected/e4e16959-9d62-4db9-b79a-86d60d777e5f-kube-api-access-jfq6k\") pod \"dns-operator-controller-manager-864dd78c4c-shgw4\" (UID: \"e4e16959-9d62-4db9-b79a-86d60d777e5f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" Jun 11 15:12:15.520356 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.520332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" Jun 11 15:12:15.697350 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:15.697255 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4"] Jun 11 15:12:15.700352 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:12:15.700299 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e16959_9d62_4db9_b79a_86d60d777e5f.slice/crio-97b2757087b38ce2157cb01c675900f92b7907f9667de9f9eda4360ba2d2ec0f WatchSource:0}: Error finding container 97b2757087b38ce2157cb01c675900f92b7907f9667de9f9eda4360ba2d2ec0f: Status 404 returned error can't find the container with id 97b2757087b38ce2157cb01c675900f92b7907f9667de9f9eda4360ba2d2ec0f Jun 11 15:12:16.376449 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:16.376419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" event={"ID":"e4e16959-9d62-4db9-b79a-86d60d777e5f","Type":"ContainerStarted","Data":"97b2757087b38ce2157cb01c675900f92b7907f9667de9f9eda4360ba2d2ec0f"} Jun 11 15:12:18.388841 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:18.388780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" event={"ID":"e4e16959-9d62-4db9-b79a-86d60d777e5f","Type":"ContainerStarted","Data":"79654367ca0f6ef768d805ed38739ae23f3e603fbf4e829065d5b6b510fdc747"} Jun 11 15:12:18.389241 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:18.388944 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" Jun 11 15:12:18.414569 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:18.414523 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" podStartSLOduration=1.20255512 podStartE2EDuration="3.414509151s" totalImagesPullingTime="2.211954031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:12:18.413910894 +0000 UTC m=+415.531402809" watchObservedRunningTime="2026-06-11 15:12:18.414509151 +0000 UTC m=+415.532001067" Jun 11 15:12:19.417580 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.417545 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9"] Jun 11 15:12:19.420103 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.420087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" Jun 11 15:12:19.424488 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.424467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4lhgx\"" Jun 11 15:12:19.438219 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.438195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9"] Jun 11 15:12:19.510103 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.510078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7p2h\" (UniqueName: \"kubernetes.io/projected/29cdd26e-70d0-4666-949c-9df9449af8a8-kube-api-access-h7p2h\") pod \"authorino-operator-75cc8d5cb7-tp4q9\" (UID: \"29cdd26e-70d0-4666-949c-9df9449af8a8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" Jun 11 15:12:19.611756 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.611712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7p2h\" (UniqueName: \"kubernetes.io/projected/29cdd26e-70d0-4666-949c-9df9449af8a8-kube-api-access-h7p2h\") pod \"authorino-operator-75cc8d5cb7-tp4q9\" (UID: \"29cdd26e-70d0-4666-949c-9df9449af8a8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" Jun 11 15:12:19.623382 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.623350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7p2h\" (UniqueName: \"kubernetes.io/projected/29cdd26e-70d0-4666-949c-9df9449af8a8-kube-api-access-h7p2h\") pod \"authorino-operator-75cc8d5cb7-tp4q9\" (UID: \"29cdd26e-70d0-4666-949c-9df9449af8a8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" Jun 11 15:12:19.729838 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.729727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" Jun 11 15:12:19.869398 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:19.869376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9"] Jun 11 15:12:19.872368 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:12:19.872338 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29cdd26e_70d0_4666_949c_9df9449af8a8.slice/crio-17ef1069788a371b011ecd837d38e720d58785c5febc10b7969725991d6ba03b WatchSource:0}: Error finding container 17ef1069788a371b011ecd837d38e720d58785c5febc10b7969725991d6ba03b: Status 404 returned error can't find the container with id 17ef1069788a371b011ecd837d38e720d58785c5febc10b7969725991d6ba03b Jun 11 15:12:20.103759 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.103725 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69ff47d4fb-d9r5g"] Jun 11 15:12:20.106962 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.106946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.118594 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:20.118566 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-config\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" Jun 11 15:12:20.119016 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:20.118993 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-oauth-config\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" Jun 11 15:12:20.119062 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:20.118993 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"oauth-serving-cert\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" Jun 11 15:12:20.119577 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.119561 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 15:12:20.119759 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.119743 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 15:12:20.119844 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.119766 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2vkdz\"" Jun 11 15:12:20.123688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.123671 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 15:12:20.150390 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.150363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ff47d4fb-d9r5g"] Jun 11 15:12:20.217070 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.217037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-service-ca\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.217240 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.217077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-console-config\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.217240 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.217100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v6g7\" (UniqueName: \"kubernetes.io/projected/e07463fd-5c37-4407-84df-f4ca7227b209-kube-api-access-9v6g7\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.217240 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.217202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07463fd-5c37-4407-84df-f4ca7227b209-console-serving-cert\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.217364 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.217228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07463fd-5c37-4407-84df-f4ca7227b209-console-oauth-config\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.217364 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.217262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-oauth-serving-cert\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.217428 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.217367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-trusted-ca-bundle\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.318302 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.318270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-trusted-ca-bundle\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.318498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.318324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-service-ca\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.318498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.318356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-console-config\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.318498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.318377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v6g7\" (UniqueName: \"kubernetes.io/projected/e07463fd-5c37-4407-84df-f4ca7227b209-kube-api-access-9v6g7\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.318498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.318409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07463fd-5c37-4407-84df-f4ca7227b209-console-serving-cert\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.318498 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.318434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07463fd-5c37-4407-84df-f4ca7227b209-console-oauth-config\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.318777 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.318581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-oauth-serving-cert\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.319098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.319074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-service-ca\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.319602 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.319579 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-trusted-ca-bundle\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.321527 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.321501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07463fd-5c37-4407-84df-f4ca7227b209-console-serving-cert\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.329011 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.328991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v6g7\" (UniqueName: \"kubernetes.io/projected/e07463fd-5c37-4407-84df-f4ca7227b209-kube-api-access-9v6g7\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:20.401184 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:20.401067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" event={"ID":"29cdd26e-70d0-4666-949c-9df9449af8a8","Type":"ContainerStarted","Data":"17ef1069788a371b011ecd837d38e720d58785c5febc10b7969725991d6ba03b"} Jun 11 15:12:21.031075 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.031036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 15:12:21.042492 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.042455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07463fd-5c37-4407-84df-f4ca7227b209-console-oauth-config\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:21.319895 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:21.319789 2576 configmap.go:193] Couldn't get configMap openshift-console/console-config: failed to sync configmap cache: timed out waiting for the condition Jun 11 15:12:21.319895 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:21.319897 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-console-config podName:e07463fd-5c37-4407-84df-f4ca7227b209 nodeName:}" failed. No retries permitted until 2026-06-11 15:12:21.819879127 +0000 UTC m=+418.937371021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-console-config") pod "console-69ff47d4fb-d9r5g" (UID: "e07463fd-5c37-4407-84df-f4ca7227b209") : failed to sync configmap cache: timed out waiting for the condition Jun 11 15:12:21.320166 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:21.319790 2576 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: failed to sync configmap cache: timed out waiting for the condition Jun 11 15:12:21.320166 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:21.319997 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-oauth-serving-cert podName:e07463fd-5c37-4407-84df-f4ca7227b209 nodeName:}" failed. No retries permitted until 2026-06-11 15:12:21.819970041 +0000 UTC m=+418.937461952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-oauth-serving-cert") pod "console-69ff47d4fb-d9r5g" (UID: "e07463fd-5c37-4407-84df-f4ca7227b209") : failed to sync configmap cache: timed out waiting for the condition Jun 11 15:12:21.450888 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.450858 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 15:12:21.518015 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.517985 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 15:12:21.833832 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.833780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-console-config\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:21.834017 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.833855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-oauth-serving-cert\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:21.834568 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.834541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-oauth-serving-cert\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:21.834657 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.834573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07463fd-5c37-4407-84df-f4ca7227b209-console-config\") pod \"console-69ff47d4fb-d9r5g\" (UID: \"e07463fd-5c37-4407-84df-f4ca7227b209\") " pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:21.916684 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:21.916646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:22.085265 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:22.085241 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ff47d4fb-d9r5g"] Jun 11 15:12:22.087348 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:12:22.087312 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07463fd_5c37_4407_84df_f4ca7227b209.slice/crio-9f053e85d32fd4b4473a445193bd592c12b2b53bf7f3a95d73cb55dde16b7c08 WatchSource:0}: Error finding container 9f053e85d32fd4b4473a445193bd592c12b2b53bf7f3a95d73cb55dde16b7c08: Status 404 returned error can't find the container with id 9f053e85d32fd4b4473a445193bd592c12b2b53bf7f3a95d73cb55dde16b7c08 Jun 11 15:12:22.413502 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:22.413402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" event={"ID":"29cdd26e-70d0-4666-949c-9df9449af8a8","Type":"ContainerStarted","Data":"b4692bfe11a57828106356bda44d583630333418920a7484158dff81e09b4028"} Jun 11 15:12:22.413683 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:22.413519 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" Jun 11 15:12:22.414949 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:22.414922 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff47d4fb-d9r5g" event={"ID":"e07463fd-5c37-4407-84df-f4ca7227b209","Type":"ContainerStarted","Data":"583fa43ef66d547ecbbe8c42bb73f661480339bd279b489cb236a046c70c2395"} Jun 11 15:12:22.415053 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:22.414967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ff47d4fb-d9r5g" event={"ID":"e07463fd-5c37-4407-84df-f4ca7227b209","Type":"ContainerStarted","Data":"9f053e85d32fd4b4473a445193bd592c12b2b53bf7f3a95d73cb55dde16b7c08"} Jun 11 15:12:22.446119 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:22.446068 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" podStartSLOduration=1.365646102 podStartE2EDuration="3.446054418s" totalImagesPullingTime="2.080408316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:12:22.443913798 +0000 UTC m=+419.561405714" watchObservedRunningTime="2026-06-11 15:12:22.446054418 +0000 UTC m=+419.563546334" Jun 11 15:12:22.471995 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:22.471933 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69ff47d4fb-d9r5g" podStartSLOduration=2.4719181519999998 podStartE2EDuration="2.471918152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:12:22.470488407 +0000 UTC m=+419.587980331" watchObservedRunningTime="2026-06-11 15:12:22.471918152 +0000 UTC m=+419.589410069" Jun 11 15:12:25.121258 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.121224 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf"] Jun 11 15:12:25.125011 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.124995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.128284 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.128263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tjrzb\"" Jun 11 15:12:25.169628 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.169600 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf"] Jun 11 15:12:25.278059 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.278028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dbd6da8-8801-4158-8753-4d8562ef81fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.278220 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.278135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvd82\" (UniqueName: \"kubernetes.io/projected/0dbd6da8-8801-4158-8753-4d8562ef81fc-kube-api-access-cvd82\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.378748 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.378665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvd82\" (UniqueName: \"kubernetes.io/projected/0dbd6da8-8801-4158-8753-4d8562ef81fc-kube-api-access-cvd82\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.378748 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.378729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dbd6da8-8801-4158-8753-4d8562ef81fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.379097 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.379081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dbd6da8-8801-4158-8753-4d8562ef81fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.397545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.397522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvd82\" (UniqueName: \"kubernetes.io/projected/0dbd6da8-8801-4158-8753-4d8562ef81fc-kube-api-access-cvd82\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.435640 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.435616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:25.597858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:25.597772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf"] Jun 11 15:12:25.597972 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:12:25.597932 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbd6da8_8801_4158_8753_4d8562ef81fc.slice/crio-2bc41136499cbd8ff2d47f55b491d3b825f3fb41baee4a07069cd05941c11574 WatchSource:0}: Error finding container 2bc41136499cbd8ff2d47f55b491d3b825f3fb41baee4a07069cd05941c11574: Status 404 returned error can't find the container with id 2bc41136499cbd8ff2d47f55b491d3b825f3fb41baee4a07069cd05941c11574 Jun 11 15:12:26.438015 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:26.437962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" event={"ID":"0dbd6da8-8801-4158-8753-4d8562ef81fc","Type":"ContainerStarted","Data":"2bc41136499cbd8ff2d47f55b491d3b825f3fb41baee4a07069cd05941c11574"} Jun 11 15:12:29.396506 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:29.396473 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-shgw4" Jun 11 15:12:30.459383 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:30.459344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" event={"ID":"0dbd6da8-8801-4158-8753-4d8562ef81fc","Type":"ContainerStarted","Data":"da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0"} Jun 11 15:12:30.459755 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:30.459499 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:30.497848 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:30.497783 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" podStartSLOduration=0.727187776 podStartE2EDuration="5.497767287s" totalImagesPullingTime="4.770579511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:12:30.495321533 +0000 UTC m=+427.612813446" watchObservedRunningTime="2026-06-11 15:12:30.497767287 +0000 UTC m=+427.615259202" Jun 11 15:12:31.917038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:31.916994 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:31.917507 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:31.917064 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:31.922387 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:31.922352 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:32.474915 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:32.474880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69ff47d4fb-d9r5g" Jun 11 15:12:33.422901 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:33.422872 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tp4q9" Jun 11 15:12:41.467998 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:41.467917 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:43.471360 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.471327 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf"] Jun 11 15:12:43.471760 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.471495 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" containerName="manager" containerID="cri-o://da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0" gracePeriod=2 Jun 11 15:12:43.479980 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.479953 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf"] Jun 11 15:12:43.504223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.504193 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz"] Jun 11 15:12:43.504825 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.504786 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" containerName="manager" Jun 11 15:12:43.504870 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.504828 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" containerName="manager" Jun 11 15:12:43.504955 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.504944 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" containerName="manager" Jun 11 15:12:43.507271 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.507252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.523890 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.523865 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz"] Jun 11 15:12:43.552034 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:43.551994 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:43.558369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.558346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bac92f-1845-4f9e-a906-b66c579c0764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdtlz\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.558487 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.558402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvb9p\" (UniqueName: \"kubernetes.io/projected/a8bac92f-1845-4f9e-a906-b66c579c0764-kube-api-access-fvb9p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdtlz\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.604309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.604278 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc"] Jun 11 15:12:43.606874 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.606857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.637830 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.637767 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc"] Jun 11 15:12:43.659907 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.659878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30af5cd0-4889-44bc-b596-8203d679d845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5bpc\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.660044 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.659985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bac92f-1845-4f9e-a906-b66c579c0764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdtlz\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.660117 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.660056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5vm\" (UniqueName: \"kubernetes.io/projected/30af5cd0-4889-44bc-b596-8203d679d845-kube-api-access-zs5vm\") pod \"kuadrant-operator-controller-manager-86878c769f-v5bpc\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.660168 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.660128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvb9p\" (UniqueName: \"kubernetes.io/projected/a8bac92f-1845-4f9e-a906-b66c579c0764-kube-api-access-fvb9p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdtlz\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.660400 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.660377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bac92f-1845-4f9e-a906-b66c579c0764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdtlz\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.665279 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:43.665248 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:43.678200 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.678175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvb9p\" (UniqueName: \"kubernetes.io/projected/a8bac92f-1845-4f9e-a906-b66c579c0764-kube-api-access-fvb9p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdtlz\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.725829 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.725752 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:43.727907 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:43.727881 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:43.761079 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.761055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30af5cd0-4889-44bc-b596-8203d679d845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5bpc\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.761207 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.761109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5vm\" (UniqueName: \"kubernetes.io/projected/30af5cd0-4889-44bc-b596-8203d679d845-kube-api-access-zs5vm\") pod \"kuadrant-operator-controller-manager-86878c769f-v5bpc\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.761406 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.761388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30af5cd0-4889-44bc-b596-8203d679d845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5bpc\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.772897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.772877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5vm\" (UniqueName: \"kubernetes.io/projected/30af5cd0-4889-44bc-b596-8203d679d845-kube-api-access-zs5vm\") pod \"kuadrant-operator-controller-manager-86878c769f-v5bpc\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.842581 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.842544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:43.862068 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.862032 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dbd6da8-8801-4158-8753-4d8562ef81fc-extensions-socket-volume\") pod \"0dbd6da8-8801-4158-8753-4d8562ef81fc\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " Jun 11 15:12:43.862192 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.862098 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvd82\" (UniqueName: \"kubernetes.io/projected/0dbd6da8-8801-4158-8753-4d8562ef81fc-kube-api-access-cvd82\") pod \"0dbd6da8-8801-4158-8753-4d8562ef81fc\" (UID: \"0dbd6da8-8801-4158-8753-4d8562ef81fc\") " Jun 11 15:12:43.862461 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.862438 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dbd6da8-8801-4158-8753-4d8562ef81fc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0dbd6da8-8801-4158-8753-4d8562ef81fc" (UID: "0dbd6da8-8801-4158-8753-4d8562ef81fc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:12:43.864494 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.864465 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dbd6da8-8801-4158-8753-4d8562ef81fc-kube-api-access-cvd82" (OuterVolumeSpecName: "kube-api-access-cvd82") pod "0dbd6da8-8801-4158-8753-4d8562ef81fc" (UID: "0dbd6da8-8801-4158-8753-4d8562ef81fc"). InnerVolumeSpecName "kube-api-access-cvd82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:12:43.917438 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.917409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:43.963597 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.963563 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0dbd6da8-8801-4158-8753-4d8562ef81fc-extensions-socket-volume\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:12:43.963597 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.963596 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvd82\" (UniqueName: \"kubernetes.io/projected/0dbd6da8-8801-4158-8753-4d8562ef81fc-kube-api-access-cvd82\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:12:43.989071 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:43.989049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz"] Jun 11 15:12:43.991416 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:12:43.991390 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bac92f_1845_4f9e_a906_b66c579c0764.slice/crio-d765f9c6178d59f624efe24f1fd78146fa0b5e574584710a7f4191bf4db6f253 WatchSource:0}: Error finding container d765f9c6178d59f624efe24f1fd78146fa0b5e574584710a7f4191bf4db6f253: Status 404 returned error can't find the container with id d765f9c6178d59f624efe24f1fd78146fa0b5e574584710a7f4191bf4db6f253 Jun 11 15:12:44.069132 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.069110 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc"] Jun 11 15:12:44.071895 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:12:44.071860 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30af5cd0_4889_44bc_b596_8203d679d845.slice/crio-aae7ae7b158b6945fc9ef656a99e6c1066b2b93521ec5e9e1342b91688089ff0 WatchSource:0}: Error finding container aae7ae7b158b6945fc9ef656a99e6c1066b2b93521ec5e9e1342b91688089ff0: Status 404 returned error can't find the container with id aae7ae7b158b6945fc9ef656a99e6c1066b2b93521ec5e9e1342b91688089ff0 Jun 11 15:12:44.542554 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.542491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" event={"ID":"a8bac92f-1845-4f9e-a906-b66c579c0764","Type":"ContainerStarted","Data":"2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c"} Jun 11 15:12:44.543038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.542575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" event={"ID":"a8bac92f-1845-4f9e-a906-b66c579c0764","Type":"ContainerStarted","Data":"d765f9c6178d59f624efe24f1fd78146fa0b5e574584710a7f4191bf4db6f253"} Jun 11 15:12:44.543038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.542616 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:44.547758 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.547708 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" event={"ID":"30af5cd0-4889-44bc-b596-8203d679d845","Type":"ContainerStarted","Data":"8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f"} Jun 11 15:12:44.547945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.547764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" event={"ID":"30af5cd0-4889-44bc-b596-8203d679d845","Type":"ContainerStarted","Data":"aae7ae7b158b6945fc9ef656a99e6c1066b2b93521ec5e9e1342b91688089ff0"} Jun 11 15:12:44.547945 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.547824 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:44.549572 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.549548 2576 generic.go:356] "Generic (PLEG): container finished" podID="0dbd6da8-8801-4158-8753-4d8562ef81fc" containerID="da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0" exitCode=0 Jun 11 15:12:44.549696 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.549587 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:44.549696 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.549612 2576 scope.go:117] "RemoveContainer" containerID="da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0" Jun 11 15:12:44.559503 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.559486 2576 scope.go:117] "RemoveContainer" containerID="da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0" Jun 11 15:12:44.559745 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:44.559726 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0\": container with ID starting with da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0 not found: ID does not exist" containerID="da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0" Jun 11 15:12:44.559835 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.559752 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0"} err="failed to get container status \"da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0\": rpc error: code = NotFound desc = could not find container \"da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0\": container with ID starting with da88ea5364f7fc3f18635bcd438291c787d1692725cfc277aaa52c37c0a59dd0 not found: ID does not exist" Jun 11 15:12:44.568740 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.568680 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" podStartSLOduration=1.5686643390000001 podStartE2EDuration="1.568664339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:12:44.568044623 +0000 UTC m=+441.685536540" watchObservedRunningTime="2026-06-11 15:12:44.568664339 +0000 UTC m=+441.686156257" Jun 11 15:12:44.570816 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:44.570775 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:44.592554 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:44.592514 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zsvf\" is forbidden: User \"system:node:ip-10-0-136-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-38.ec2.internal' and this object" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zsvf" Jun 11 15:12:44.593534 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:44.593492 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" podStartSLOduration=1.593479663 podStartE2EDuration="1.593479663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:12:44.590477604 +0000 UTC m=+441.707969521" watchObservedRunningTime="2026-06-11 15:12:44.593479663 +0000 UTC m=+441.710971579" Jun 11 15:12:45.323539 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:45.323506 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dbd6da8-8801-4158-8753-4d8562ef81fc" path="/var/lib/kubelet/pods/0dbd6da8-8801-4158-8753-4d8562ef81fc/volumes" Jun 11 15:12:55.558749 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.558716 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:12:55.559233 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.558787 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:55.639746 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.639710 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz"] Jun 11 15:12:55.639983 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.639960 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" podUID="a8bac92f-1845-4f9e-a906-b66c579c0764" containerName="manager" containerID="cri-o://2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c" gracePeriod=10 Jun 11 15:12:55.904441 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.904418 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:55.977343 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.977315 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvb9p\" (UniqueName: \"kubernetes.io/projected/a8bac92f-1845-4f9e-a906-b66c579c0764-kube-api-access-fvb9p\") pod \"a8bac92f-1845-4f9e-a906-b66c579c0764\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " Jun 11 15:12:55.977504 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.977360 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bac92f-1845-4f9e-a906-b66c579c0764-extensions-socket-volume\") pod \"a8bac92f-1845-4f9e-a906-b66c579c0764\" (UID: \"a8bac92f-1845-4f9e-a906-b66c579c0764\") " Jun 11 15:12:55.977752 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.977729 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bac92f-1845-4f9e-a906-b66c579c0764-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a8bac92f-1845-4f9e-a906-b66c579c0764" (UID: "a8bac92f-1845-4f9e-a906-b66c579c0764"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:12:55.979366 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:55.979343 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8bac92f-1845-4f9e-a906-b66c579c0764-kube-api-access-fvb9p" (OuterVolumeSpecName: "kube-api-access-fvb9p") pod "a8bac92f-1845-4f9e-a906-b66c579c0764" (UID: "a8bac92f-1845-4f9e-a906-b66c579c0764"). InnerVolumeSpecName "kube-api-access-fvb9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:12:56.078790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.078701 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvb9p\" (UniqueName: \"kubernetes.io/projected/a8bac92f-1845-4f9e-a906-b66c579c0764-kube-api-access-fvb9p\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:12:56.078790 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.078734 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8bac92f-1845-4f9e-a906-b66c579c0764-extensions-socket-volume\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:12:56.618158 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.618122 2576 generic.go:356] "Generic (PLEG): container finished" podID="a8bac92f-1845-4f9e-a906-b66c579c0764" containerID="2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c" exitCode=0 Jun 11 15:12:56.618549 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.618180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" event={"ID":"a8bac92f-1845-4f9e-a906-b66c579c0764","Type":"ContainerDied","Data":"2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c"} Jun 11 15:12:56.618549 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.618185 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" Jun 11 15:12:56.618549 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.618248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz" event={"ID":"a8bac92f-1845-4f9e-a906-b66c579c0764","Type":"ContainerDied","Data":"d765f9c6178d59f624efe24f1fd78146fa0b5e574584710a7f4191bf4db6f253"} Jun 11 15:12:56.618549 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.618270 2576 scope.go:117] "RemoveContainer" containerID="2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c" Jun 11 15:12:56.627307 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.627288 2576 scope.go:117] "RemoveContainer" containerID="2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c" Jun 11 15:12:56.627574 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:12:56.627557 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c\": container with ID starting with 2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c not found: ID does not exist" containerID="2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c" Jun 11 15:12:56.627621 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.627582 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c"} err="failed to get container status \"2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c\": rpc error: code = NotFound desc = could not find container \"2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c\": container with ID starting with 2d35b6cd256fbef0fea22aaf7768dc65572c93324501ed4c9657e1f24967045c not found: ID does not exist" Jun 11 15:12:56.644372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.644345 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz"] Jun 11 15:12:56.653607 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:56.653583 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdtlz"] Jun 11 15:12:57.323647 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:12:57.323614 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8bac92f-1845-4f9e-a906-b66c579c0764" path="/var/lib/kubelet/pods/a8bac92f-1845-4f9e-a906-b66c579c0764/volumes" Jun 11 15:13:11.978912 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:11.978879 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx"] Jun 11 15:13:11.979363 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:11.979349 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8bac92f-1845-4f9e-a906-b66c579c0764" containerName="manager" Jun 11 15:13:11.979363 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:11.979364 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bac92f-1845-4f9e-a906-b66c579c0764" containerName="manager" Jun 11 15:13:11.979480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:11.979433 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8bac92f-1845-4f9e-a906-b66c579c0764" containerName="manager" Jun 11 15:13:11.981866 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:11.981845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:11.984206 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:11.984175 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cjlqz\"" Jun 11 15:13:12.005480 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.005454 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx"] Jun 11 15:13:12.032223 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032361 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-workload-certs\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032361 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gtj\" (UniqueName: \"kubernetes.io/projected/6d0a5ce7-0dd4-4cc4-987c-27688381f981-kube-api-access-w7gtj\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032477 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-credential-socket\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032477 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032579 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-workload-socket\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032632 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-data\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032687 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-envoy\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.032687 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.032650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-token\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.133420 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-workload-certs\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.133619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gtj\" (UniqueName: \"kubernetes.io/projected/6d0a5ce7-0dd4-4cc4-987c-27688381f981-kube-api-access-w7gtj\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.133619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-credential-socket\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.133619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.133619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-workload-socket\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.133619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-data\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.133619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-envoy\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.134004 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-token\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.134004 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.134004 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.133878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-workload-certs\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.134163 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.134060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-credential-socket\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.134163 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.134095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-workload-socket\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.134308 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.134180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-data\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.134492 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.134382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.136273 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.136248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-envoy\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.136400 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.136377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.142728 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.142701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gtj\" (UniqueName: \"kubernetes.io/projected/6d0a5ce7-0dd4-4cc4-987c-27688381f981-kube-api-access-w7gtj\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.142896 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.142874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d0a5ce7-0dd4-4cc4-987c-27688381f981-istio-token\") pod \"maas-default-gateway-openshift-default-7c4d88f86d-697nx\" (UID: \"6d0a5ce7-0dd4-4cc4-987c-27688381f981\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.292617 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.292577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:12.441510 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.441487 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx"] Jun 11 15:13:12.444210 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:13:12.444177 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0a5ce7_0dd4_4cc4_987c_27688381f981.slice/crio-abda848c139aee11845a6dc1751b0214084fc5a2d7277efe778d653faa2ecd70 WatchSource:0}: Error finding container abda848c139aee11845a6dc1751b0214084fc5a2d7277efe778d653faa2ecd70: Status 404 returned error can't find the container with id abda848c139aee11845a6dc1751b0214084fc5a2d7277efe778d653faa2ecd70 Jun 11 15:13:12.446634 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.446602 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:13:12.446732 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.446667 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:13:12.446732 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.446697 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:13:12.703816 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.703712 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" event={"ID":"6d0a5ce7-0dd4-4cc4-987c-27688381f981","Type":"ContainerStarted","Data":"de9aa295fcb2b79af06a7333b193a8fbf828b00eedd796e1ce6d2ce87df53a57"} Jun 11 15:13:12.703816 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.703763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" event={"ID":"6d0a5ce7-0dd4-4cc4-987c-27688381f981","Type":"ContainerStarted","Data":"abda848c139aee11845a6dc1751b0214084fc5a2d7277efe778d653faa2ecd70"} Jun 11 15:13:12.724065 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:12.724008 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" podStartSLOduration=1.723991495 podStartE2EDuration="1.723991495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:13:12.722713554 +0000 UTC m=+469.840205481" watchObservedRunningTime="2026-06-11 15:13:12.723991495 +0000 UTC m=+469.841483410" Jun 11 15:13:13.292932 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:13.292888 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:13.297432 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:13.297407 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:13.715381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:13.715293 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:13.716372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:13.716350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:13:23.327600 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:13:23.327574 2576 scope.go:117] "RemoveContainer" containerID="2534e48575f3c16949ef3c59e7b0c67fcbed1e828d2a19eee506e2a4ccd7c9d5" Jun 11 15:14:09.486662 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.486579 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:14:09.489880 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.489861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:09.492123 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.492087 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:14:09.492307 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.492291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:14:09.492353 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.492291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nmjfd\"" Jun 11 15:14:09.492564 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.492552 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:14:09.502393 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.502371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:14:09.607504 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.607469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49x2n\" (UniqueName: \"kubernetes.io/projected/8ef9c90f-8dcc-48d3-b654-c1b5016d6476-kube-api-access-49x2n\") pod \"maas-keycloak-0\" (UID: \"8ef9c90f-8dcc-48d3-b654-c1b5016d6476\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:09.708580 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.708531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49x2n\" (UniqueName: \"kubernetes.io/projected/8ef9c90f-8dcc-48d3-b654-c1b5016d6476-kube-api-access-49x2n\") pod \"maas-keycloak-0\" (UID: \"8ef9c90f-8dcc-48d3-b654-c1b5016d6476\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:09.717437 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.717405 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49x2n\" (UniqueName: \"kubernetes.io/projected/8ef9c90f-8dcc-48d3-b654-c1b5016d6476-kube-api-access-49x2n\") pod \"maas-keycloak-0\" (UID: \"8ef9c90f-8dcc-48d3-b654-c1b5016d6476\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:09.799694 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.799656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:09.940532 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:09.940336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:14:09.943824 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:14:09.943782 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef9c90f_8dcc_48d3_b654_c1b5016d6476.slice/crio-e390a8979d96b2331dc29512272209d9796351f43d748f6094391047f29061a5 WatchSource:0}: Error finding container e390a8979d96b2331dc29512272209d9796351f43d748f6094391047f29061a5: Status 404 returned error can't find the container with id e390a8979d96b2331dc29512272209d9796351f43d748f6094391047f29061a5 Jun 11 15:14:10.007080 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:10.006925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ef9c90f-8dcc-48d3-b654-c1b5016d6476","Type":"ContainerStarted","Data":"e390a8979d96b2331dc29512272209d9796351f43d748f6094391047f29061a5"} Jun 11 15:14:17.050687 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:17.050650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ef9c90f-8dcc-48d3-b654-c1b5016d6476","Type":"ContainerStarted","Data":"268bf82b09e3b6c215fa7e0be744decc616adbbd3d6070449bc364c343d99695"} Jun 11 15:14:17.072108 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:17.072004 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.897787311 podStartE2EDuration="8.071982709s" totalImagesPullingTime="6.174195398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:14:17.071072675 +0000 UTC m=+534.188564590" watchObservedRunningTime="2026-06-11 15:14:17.071982709 +0000 UTC m=+534.189474621" Jun 11 15:14:17.800035 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:17.799988 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:17.801636 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:17.801586 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:18.800576 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:18.800521 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:19.800688 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:19.800625 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:19.801411 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:19.801371 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:20.800721 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:20.800671 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:21.800932 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:21.800873 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:22.801097 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:22.801039 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:23.800992 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:23.800932 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:24.800920 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:24.800864 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:25.800872 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:25.800785 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:26.801124 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:26.801070 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:27.800415 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:27.800357 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:28.800912 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:28.800854 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 11 15:14:29.935137 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:29.935101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:29.955608 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:29.955553 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:14:39.941259 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:39.941223 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:14:46.363348 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.363309 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-588797b4cb-n8gsw"] Jun 11 15:14:46.370263 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.370239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.372326 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.372301 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 15:14:46.372454 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.372311 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 15:14:46.372940 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.372915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5vvq\"" Jun 11 15:14:46.379394 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.379370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-588797b4cb-n8gsw"] Jun 11 15:14:46.506030 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.505986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkb9p\" (UniqueName: \"kubernetes.io/projected/9874e899-ace0-4bea-808b-9a7628e59698-kube-api-access-bkb9p\") pod \"maas-controller-588797b4cb-n8gsw\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.506207 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.506048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9874e899-ace0-4bea-808b-9a7628e59698-webhook-cert\") pod \"maas-controller-588797b4cb-n8gsw\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.569595 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.569560 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5978c9768d-xrgqb"] Jun 11 15:14:46.572140 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.572121 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:46.586085 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.586061 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5978c9768d-xrgqb"] Jun 11 15:14:46.606997 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.606964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkb9p\" (UniqueName: \"kubernetes.io/projected/9874e899-ace0-4bea-808b-9a7628e59698-kube-api-access-bkb9p\") pod \"maas-controller-588797b4cb-n8gsw\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.607101 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.607008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9874e899-ace0-4bea-808b-9a7628e59698-webhook-cert\") pod \"maas-controller-588797b4cb-n8gsw\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.609511 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.609492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9874e899-ace0-4bea-808b-9a7628e59698-webhook-cert\") pod \"maas-controller-588797b4cb-n8gsw\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.616587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.616534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkb9p\" (UniqueName: \"kubernetes.io/projected/9874e899-ace0-4bea-808b-9a7628e59698-kube-api-access-bkb9p\") pod \"maas-controller-588797b4cb-n8gsw\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.682247 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.682222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:46.708134 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.708107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjs46\" (UniqueName: \"kubernetes.io/projected/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-kube-api-access-vjs46\") pod \"maas-controller-5978c9768d-xrgqb\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:46.708253 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.708181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-webhook-cert\") pod \"maas-controller-5978c9768d-xrgqb\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:46.809080 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.809046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjs46\" (UniqueName: \"kubernetes.io/projected/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-kube-api-access-vjs46\") pod \"maas-controller-5978c9768d-xrgqb\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:46.809252 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.809111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-webhook-cert\") pod \"maas-controller-5978c9768d-xrgqb\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:46.811525 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.811492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-webhook-cert\") pod \"maas-controller-5978c9768d-xrgqb\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:46.814459 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.814436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-588797b4cb-n8gsw"] Jun 11 15:14:46.816975 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:14:46.816949 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9874e899_ace0_4bea_808b_9a7628e59698.slice/crio-ccaf274b33faee09e22601bddd0825bcef1c04430fe8ec10df78698d9bb344e5 WatchSource:0}: Error finding container ccaf274b33faee09e22601bddd0825bcef1c04430fe8ec10df78698d9bb344e5: Status 404 returned error can't find the container with id ccaf274b33faee09e22601bddd0825bcef1c04430fe8ec10df78698d9bb344e5 Jun 11 15:14:46.817554 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.817531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjs46\" (UniqueName: \"kubernetes.io/projected/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-kube-api-access-vjs46\") pod \"maas-controller-5978c9768d-xrgqb\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:46.882753 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:46.882696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:47.025957 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:47.025928 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5978c9768d-xrgqb"] Jun 11 15:14:47.028456 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:14:47.028431 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9833b6e4_c5a8_4046_aaf1_2e2acfdd4055.slice/crio-5cfc8f6ba9895e77bc08c08e237d7df26bd85225fe3776f5663914779fdbbc2c WatchSource:0}: Error finding container 5cfc8f6ba9895e77bc08c08e237d7df26bd85225fe3776f5663914779fdbbc2c: Status 404 returned error can't find the container with id 5cfc8f6ba9895e77bc08c08e237d7df26bd85225fe3776f5663914779fdbbc2c Jun 11 15:14:47.267000 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:47.266965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5978c9768d-xrgqb" event={"ID":"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055","Type":"ContainerStarted","Data":"5cfc8f6ba9895e77bc08c08e237d7df26bd85225fe3776f5663914779fdbbc2c"} Jun 11 15:14:47.268545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:47.268518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588797b4cb-n8gsw" event={"ID":"9874e899-ace0-4bea-808b-9a7628e59698","Type":"ContainerStarted","Data":"ccaf274b33faee09e22601bddd0825bcef1c04430fe8ec10df78698d9bb344e5"} Jun 11 15:14:50.293336 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:50.293302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588797b4cb-n8gsw" event={"ID":"9874e899-ace0-4bea-808b-9a7628e59698","Type":"ContainerStarted","Data":"ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713"} Jun 11 15:14:50.293840 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:50.293419 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:14:50.294708 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:50.294677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5978c9768d-xrgqb" event={"ID":"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055","Type":"ContainerStarted","Data":"c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617"} Jun 11 15:14:50.294844 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:50.294831 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:14:50.314364 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:14:50.314318 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-588797b4cb-n8gsw" podStartSLOduration=1.7662288849999999 podStartE2EDuration="4.314300722s" totalImagesPullingTime="2.548071837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:14:50.312789972 +0000 UTC m=+567.430281889" watchObservedRunningTime="2026-06-11 15:14:50.314300722 +0000 UTC m=+567.431792637" Jun 11 15:15:01.306472 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.306442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:15:01.306914 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.306525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:15:01.326017 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.325962 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5978c9768d-xrgqb" podStartSLOduration=12.983422505 podStartE2EDuration="15.325947394s" totalImagesPullingTime="2.342524889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:14:50.335477173 +0000 UTC m=+567.452969092" watchObservedRunningTime="2026-06-11 15:15:01.325947394 +0000 UTC m=+578.443439307" Jun 11 15:15:01.371278 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.371234 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-588797b4cb-n8gsw"] Jun 11 15:15:01.371587 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.371558 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-588797b4cb-n8gsw" podUID="9874e899-ace0-4bea-808b-9a7628e59698" containerName="manager" containerID="cri-o://ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713" gracePeriod=30 Jun 11 15:15:01.629851 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.629827 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:15:01.759985 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.759953 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9874e899-ace0-4bea-808b-9a7628e59698-webhook-cert\") pod \"9874e899-ace0-4bea-808b-9a7628e59698\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " Jun 11 15:15:01.760207 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.760033 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkb9p\" (UniqueName: \"kubernetes.io/projected/9874e899-ace0-4bea-808b-9a7628e59698-kube-api-access-bkb9p\") pod \"9874e899-ace0-4bea-808b-9a7628e59698\" (UID: \"9874e899-ace0-4bea-808b-9a7628e59698\") " Jun 11 15:15:01.762442 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.762407 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9874e899-ace0-4bea-808b-9a7628e59698-kube-api-access-bkb9p" (OuterVolumeSpecName: "kube-api-access-bkb9p") pod "9874e899-ace0-4bea-808b-9a7628e59698" (UID: "9874e899-ace0-4bea-808b-9a7628e59698"). InnerVolumeSpecName "kube-api-access-bkb9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:15:01.762566 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.762483 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9874e899-ace0-4bea-808b-9a7628e59698-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9874e899-ace0-4bea-808b-9a7628e59698" (UID: "9874e899-ace0-4bea-808b-9a7628e59698"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:15:01.861567 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.861468 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9874e899-ace0-4bea-808b-9a7628e59698-webhook-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:15:01.861567 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:01.861506 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkb9p\" (UniqueName: \"kubernetes.io/projected/9874e899-ace0-4bea-808b-9a7628e59698-kube-api-access-bkb9p\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:15:02.360455 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.360423 2576 generic.go:356] "Generic (PLEG): container finished" podID="9874e899-ace0-4bea-808b-9a7628e59698" containerID="ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713" exitCode=0 Jun 11 15:15:02.360961 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.360469 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-588797b4cb-n8gsw" Jun 11 15:15:02.360961 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.360512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588797b4cb-n8gsw" event={"ID":"9874e899-ace0-4bea-808b-9a7628e59698","Type":"ContainerDied","Data":"ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713"} Jun 11 15:15:02.360961 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.360570 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-588797b4cb-n8gsw" event={"ID":"9874e899-ace0-4bea-808b-9a7628e59698","Type":"ContainerDied","Data":"ccaf274b33faee09e22601bddd0825bcef1c04430fe8ec10df78698d9bb344e5"} Jun 11 15:15:02.360961 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.360601 2576 scope.go:117] "RemoveContainer" containerID="ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713" Jun 11 15:15:02.370328 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.370312 2576 scope.go:117] "RemoveContainer" containerID="ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713" Jun 11 15:15:02.370560 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:15:02.370543 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713\": container with ID starting with ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713 not found: ID does not exist" containerID="ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713" Jun 11 15:15:02.370626 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.370573 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713"} err="failed to get container status \"ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713\": rpc error: code = NotFound desc = could not find container \"ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713\": container with ID starting with ab7ff175186f759a70e9a51273e46060a8807f7300ddfccdd83acd31fe562713 not found: ID does not exist" Jun 11 15:15:02.384218 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.384189 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-588797b4cb-n8gsw"] Jun 11 15:15:02.386598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:02.386575 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-588797b4cb-n8gsw"] Jun 11 15:15:03.324860 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:03.324795 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9874e899-ace0-4bea-808b-9a7628e59698" path="/var/lib/kubelet/pods/9874e899-ace0-4bea-808b-9a7628e59698/volumes" Jun 11 15:15:20.945445 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.945407 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d88fb877f-n5jpv"] Jun 11 15:15:20.946057 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.945838 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9874e899-ace0-4bea-808b-9a7628e59698" containerName="manager" Jun 11 15:15:20.946057 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.945849 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9874e899-ace0-4bea-808b-9a7628e59698" containerName="manager" Jun 11 15:15:20.946057 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.945933 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9874e899-ace0-4bea-808b-9a7628e59698" containerName="manager" Jun 11 15:15:20.948299 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.948281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:20.950383 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.950358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 15:15:20.950512 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.950411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ddlql\"" Jun 11 15:15:20.960460 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:20.960427 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d88fb877f-n5jpv"] Jun 11 15:15:21.061817 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.061776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd8f21e-ef1e-403e-8932-54f5354c53c4-openshift-service-ca\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.061987 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.061861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqtrp\" (UniqueName: \"kubernetes.io/projected/5dd8f21e-ef1e-403e-8932-54f5354c53c4-kube-api-access-cqtrp\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.061987 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.061884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd8f21e-ef1e-403e-8932-54f5354c53c4-maas-api-tls\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.162634 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.162597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqtrp\" (UniqueName: \"kubernetes.io/projected/5dd8f21e-ef1e-403e-8932-54f5354c53c4-kube-api-access-cqtrp\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.162634 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.162638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd8f21e-ef1e-403e-8932-54f5354c53c4-maas-api-tls\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.162884 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.162726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd8f21e-ef1e-403e-8932-54f5354c53c4-openshift-service-ca\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.162884 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:15:21.162834 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 15:15:21.162952 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:15:21.162924 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dd8f21e-ef1e-403e-8932-54f5354c53c4-maas-api-tls podName:5dd8f21e-ef1e-403e-8932-54f5354c53c4 nodeName:}" failed. No retries permitted until 2026-06-11 15:15:21.662901214 +0000 UTC m=+598.780393111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5dd8f21e-ef1e-403e-8932-54f5354c53c4-maas-api-tls") pod "maas-api-5d88fb877f-n5jpv" (UID: "5dd8f21e-ef1e-403e-8932-54f5354c53c4") : secret "maas-api-serving-cert" not found Jun 11 15:15:21.163369 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.163352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd8f21e-ef1e-403e-8932-54f5354c53c4-openshift-service-ca\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.171500 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.171475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqtrp\" (UniqueName: \"kubernetes.io/projected/5dd8f21e-ef1e-403e-8932-54f5354c53c4-kube-api-access-cqtrp\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.457873 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.457844 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-gqk6h"] Jun 11 15:15:21.460841 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.460793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" Jun 11 15:15:21.462961 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.462934 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 15:15:21.463114 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.462947 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-48rv4\"" Jun 11 15:15:21.471358 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.470859 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-l7sml"] Jun 11 15:15:21.474670 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.474643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" Jun 11 15:15:21.475763 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.475741 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-gqk6h"] Jun 11 15:15:21.489653 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.489624 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-l7sml"] Jun 11 15:15:21.567706 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.567667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd7lw\" (UniqueName: \"kubernetes.io/projected/9e916930-703d-49e8-a96f-ed214d3fcba2-kube-api-access-hd7lw\") pod \"payload-pre-processing-579785bc64-gqk6h\" (UID: \"9e916930-703d-49e8-a96f-ed214d3fcba2\") " pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" Jun 11 15:15:21.567706 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.567708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42s2h\" (UniqueName: \"kubernetes.io/projected/41e93811-b6e2-40c0-87a7-68bf18e4618d-kube-api-access-42s2h\") pod \"payload-processing-699b6cd6c-l7sml\" (UID: \"41e93811-b6e2-40c0-87a7-68bf18e4618d\") " pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" Jun 11 15:15:21.668649 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.668611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd7lw\" (UniqueName: \"kubernetes.io/projected/9e916930-703d-49e8-a96f-ed214d3fcba2-kube-api-access-hd7lw\") pod \"payload-pre-processing-579785bc64-gqk6h\" (UID: \"9e916930-703d-49e8-a96f-ed214d3fcba2\") " pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" Jun 11 15:15:21.668649 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.668654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42s2h\" (UniqueName: \"kubernetes.io/projected/41e93811-b6e2-40c0-87a7-68bf18e4618d-kube-api-access-42s2h\") pod \"payload-processing-699b6cd6c-l7sml\" (UID: \"41e93811-b6e2-40c0-87a7-68bf18e4618d\") " pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" Jun 11 15:15:21.668959 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.668730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd8f21e-ef1e-403e-8932-54f5354c53c4-maas-api-tls\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.671387 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.671365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd8f21e-ef1e-403e-8932-54f5354c53c4-maas-api-tls\") pod \"maas-api-5d88fb877f-n5jpv\" (UID: \"5dd8f21e-ef1e-403e-8932-54f5354c53c4\") " pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.676563 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.676541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd7lw\" (UniqueName: \"kubernetes.io/projected/9e916930-703d-49e8-a96f-ed214d3fcba2-kube-api-access-hd7lw\") pod \"payload-pre-processing-579785bc64-gqk6h\" (UID: \"9e916930-703d-49e8-a96f-ed214d3fcba2\") " pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" Jun 11 15:15:21.676653 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.676621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42s2h\" (UniqueName: \"kubernetes.io/projected/41e93811-b6e2-40c0-87a7-68bf18e4618d-kube-api-access-42s2h\") pod \"payload-processing-699b6cd6c-l7sml\" (UID: \"41e93811-b6e2-40c0-87a7-68bf18e4618d\") " pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" Jun 11 15:15:21.776581 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.776539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" Jun 11 15:15:21.788763 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.788736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" Jun 11 15:15:21.860443 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.860237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:21.945987 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.945628 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-gqk6h"] Jun 11 15:15:21.977560 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:21.977536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-l7sml"] Jun 11 15:15:21.979775 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:15:21.979744 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e93811_b6e2_40c0_87a7_68bf18e4618d.slice/crio-756dc702ab371307a72807cf07dbcfb1d9ef25b89a5f8bcec2e9f7a63608ce4e WatchSource:0}: Error finding container 756dc702ab371307a72807cf07dbcfb1d9ef25b89a5f8bcec2e9f7a63608ce4e: Status 404 returned error can't find the container with id 756dc702ab371307a72807cf07dbcfb1d9ef25b89a5f8bcec2e9f7a63608ce4e Jun 11 15:15:22.033761 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:22.033736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d88fb877f-n5jpv"] Jun 11 15:15:22.035117 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:15:22.035089 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd8f21e_ef1e_403e_8932_54f5354c53c4.slice/crio-ed8460ab696090dbc1144fd154eabcdbbdad4091f3e87d8fcdbfe93f5823934e WatchSource:0}: Error finding container ed8460ab696090dbc1144fd154eabcdbbdad4091f3e87d8fcdbfe93f5823934e: Status 404 returned error can't find the container with id ed8460ab696090dbc1144fd154eabcdbbdad4091f3e87d8fcdbfe93f5823934e Jun 11 15:15:22.467751 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:22.467665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d88fb877f-n5jpv" event={"ID":"5dd8f21e-ef1e-403e-8932-54f5354c53c4","Type":"ContainerStarted","Data":"ed8460ab696090dbc1144fd154eabcdbbdad4091f3e87d8fcdbfe93f5823934e"} Jun 11 15:15:22.468954 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:22.468924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" event={"ID":"41e93811-b6e2-40c0-87a7-68bf18e4618d","Type":"ContainerStarted","Data":"756dc702ab371307a72807cf07dbcfb1d9ef25b89a5f8bcec2e9f7a63608ce4e"} Jun 11 15:15:22.470194 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:22.470172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" event={"ID":"9e916930-703d-49e8-a96f-ed214d3fcba2","Type":"ContainerStarted","Data":"09b94f3e179ac40cf80264c935c69edfb3a4d666135e7b4ef7d1a9c5095ee735"} Jun 11 15:15:25.779426 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:25.779402 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 15:15:26.502983 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.502937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" event={"ID":"41e93811-b6e2-40c0-87a7-68bf18e4618d","Type":"ContainerStarted","Data":"03f788863f0e5b812fa3f7822d207ce68ff94e6d80e7d6f8de900c7fd760a103"} Jun 11 15:15:26.503172 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.503054 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" Jun 11 15:15:26.504518 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.504489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" event={"ID":"9e916930-703d-49e8-a96f-ed214d3fcba2","Type":"ContainerStarted","Data":"a80619a42a9ddb03ffbf610ca311e8ed156913f85371c5750717deeeb28d7fc0"} Jun 11 15:15:26.504654 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.504534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" Jun 11 15:15:26.505851 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.505821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d88fb877f-n5jpv" event={"ID":"5dd8f21e-ef1e-403e-8932-54f5354c53c4","Type":"ContainerStarted","Data":"db2f82ad00c258c86166f6045a43f5b0c7065686096ba2a1110c887ca6bf106d"} Jun 11 15:15:26.505974 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.505960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:26.524267 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.524222 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" podStartSLOduration=1.729806769 podStartE2EDuration="5.524206576s" totalImagesPullingTime="3.794399807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:15:26.521765054 +0000 UTC m=+603.639256969" watchObservedRunningTime="2026-06-11 15:15:26.524206576 +0000 UTC m=+603.641698483" Jun 11 15:15:26.544207 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.544102 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5d88fb877f-n5jpv" podStartSLOduration=2.834336753 podStartE2EDuration="6.544079376s" totalImagesPullingTime="3.709742623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:15:26.541293164 +0000 UTC m=+603.658785081" watchObservedRunningTime="2026-06-11 15:15:26.544079376 +0000 UTC m=+603.661571295" Jun 11 15:15:26.557883 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:26.557827 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" podStartSLOduration=1.73066713 podStartE2EDuration="5.557789658s" totalImagesPullingTime="3.827122528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:15:26.556024192 +0000 UTC m=+603.673516101" watchObservedRunningTime="2026-06-11 15:15:26.557789658 +0000 UTC m=+603.675281574" Jun 11 15:15:29.226933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.226368 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7c4d88f86d-697nx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:45416->10.134.0.42:15021: read: connection reset by peer" start-of-body= Jun 11 15:15:29.226933 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.226437 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" podUID="6d0a5ce7-0dd4-4cc4-987c-27688381f981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:45416->10.134.0.42:15021: read: connection reset by peer" Jun 11 15:15:29.526357 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.526324 2576 generic.go:356] "Generic (PLEG): container finished" podID="6d0a5ce7-0dd4-4cc4-987c-27688381f981" containerID="de9aa295fcb2b79af06a7333b193a8fbf828b00eedd796e1ce6d2ce87df53a57" exitCode=0 Jun 11 15:15:29.526546 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.526408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" event={"ID":"6d0a5ce7-0dd4-4cc4-987c-27688381f981","Type":"ContainerDied","Data":"de9aa295fcb2b79af06a7333b193a8fbf828b00eedd796e1ce6d2ce87df53a57"} Jun 11 15:15:29.526955 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.526926 2576 scope.go:117] "RemoveContainer" containerID="de9aa295fcb2b79af06a7333b193a8fbf828b00eedd796e1ce6d2ce87df53a57" Jun 11 15:15:29.527962 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.527935 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:15:29.528090 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.528030 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:15:29.528161 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:29.528094 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:15:30.538104 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:30.538067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" event={"ID":"6d0a5ce7-0dd4-4cc4-987c-27688381f981","Type":"ContainerStarted","Data":"6afa5c53d078dc23bb9db4c9dd4be348ce87ddb24a3cebca962f7dc1a0aa6bce"} Jun 11 15:15:31.293483 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:31.293434 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:15:31.293679 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:31.293656 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7c4d88f86d-697nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 11 15:15:31.293732 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:31.293703 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" podUID="6d0a5ce7-0dd4-4cc4-987c-27688381f981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 11 15:15:32.293232 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:32.293187 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7c4d88f86d-697nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 11 15:15:32.293610 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:32.293256 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" podUID="6d0a5ce7-0dd4-4cc4-987c-27688381f981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 11 15:15:32.527112 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:32.527078 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d88fb877f-n5jpv" Jun 11 15:15:33.294051 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:33.294013 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7c4d88f86d-697nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 11 15:15:33.294444 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:33.294071 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" podUID="6d0a5ce7-0dd4-4cc4-987c-27688381f981" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 11 15:15:34.323354 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:34.323319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:15:34.323855 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:34.323711 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:15:34.324405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:34.324386 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7c4d88f86d-697nx" Jun 11 15:15:37.514811 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:37.514780 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-l7sml" Jun 11 15:15:37.515253 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:15:37.514887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-gqk6h" Jun 11 15:17:36.772440 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:36.772402 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:17:36.773013 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:36.772644 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" containerID="cri-o://268bf82b09e3b6c215fa7e0be744decc616adbbd3d6070449bc364c343d99695" gracePeriod=30 Jun 11 15:17:38.234557 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:38.234524 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerID="268bf82b09e3b6c215fa7e0be744decc616adbbd3d6070449bc364c343d99695" exitCode=143 Jun 11 15:17:38.234951 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:38.234598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ef9c90f-8dcc-48d3-b654-c1b5016d6476","Type":"ContainerDied","Data":"268bf82b09e3b6c215fa7e0be744decc616adbbd3d6070449bc364c343d99695"} Jun 11 15:17:38.826362 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:38.826335 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:38.963423 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:38.963337 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49x2n\" (UniqueName: \"kubernetes.io/projected/8ef9c90f-8dcc-48d3-b654-c1b5016d6476-kube-api-access-49x2n\") pod \"8ef9c90f-8dcc-48d3-b654-c1b5016d6476\" (UID: \"8ef9c90f-8dcc-48d3-b654-c1b5016d6476\") " Jun 11 15:17:38.965703 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:38.965672 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ef9c90f-8dcc-48d3-b654-c1b5016d6476-kube-api-access-49x2n" (OuterVolumeSpecName: "kube-api-access-49x2n") pod "8ef9c90f-8dcc-48d3-b654-c1b5016d6476" (UID: "8ef9c90f-8dcc-48d3-b654-c1b5016d6476"). InnerVolumeSpecName "kube-api-access-49x2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:17:39.064326 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.064271 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49x2n\" (UniqueName: \"kubernetes.io/projected/8ef9c90f-8dcc-48d3-b654-c1b5016d6476-kube-api-access-49x2n\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:17:39.241842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.241730 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.241842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.241737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8ef9c90f-8dcc-48d3-b654-c1b5016d6476","Type":"ContainerDied","Data":"e390a8979d96b2331dc29512272209d9796351f43d748f6094391047f29061a5"} Jun 11 15:17:39.241842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.241789 2576 scope.go:117] "RemoveContainer" containerID="268bf82b09e3b6c215fa7e0be744decc616adbbd3d6070449bc364c343d99695" Jun 11 15:17:39.265013 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.264955 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:17:39.266889 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.266866 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:17:39.294092 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.294062 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:17:39.294603 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.294577 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" Jun 11 15:17:39.294603 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.294599 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" Jun 11 15:17:39.294764 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.294692 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" containerName="keycloak" Jun 11 15:17:39.298058 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.298040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.300496 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.300473 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:17:39.300632 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.300474 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:17:39.300632 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.300475 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:17:39.300775 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.300717 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 15:17:39.300775 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.300734 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nmjfd\"" Jun 11 15:17:39.309444 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.309418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:17:39.326231 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.326191 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ef9c90f-8dcc-48d3-b654-c1b5016d6476" path="/var/lib/kubelet/pods/8ef9c90f-8dcc-48d3-b654-c1b5016d6476/volumes" Jun 11 15:17:39.468150 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.468108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbj5r\" (UniqueName: \"kubernetes.io/projected/13841642-31f2-4c79-b0bd-a7c31ae62e77-kube-api-access-wbj5r\") pod \"maas-keycloak-0\" (UID: \"13841642-31f2-4c79-b0bd-a7c31ae62e77\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.468341 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.468256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/13841642-31f2-4c79-b0bd-a7c31ae62e77-test-realms\") pod \"maas-keycloak-0\" (UID: \"13841642-31f2-4c79-b0bd-a7c31ae62e77\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.569907 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.569869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbj5r\" (UniqueName: \"kubernetes.io/projected/13841642-31f2-4c79-b0bd-a7c31ae62e77-kube-api-access-wbj5r\") pod \"maas-keycloak-0\" (UID: \"13841642-31f2-4c79-b0bd-a7c31ae62e77\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.570096 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.569956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/13841642-31f2-4c79-b0bd-a7c31ae62e77-test-realms\") pod \"maas-keycloak-0\" (UID: \"13841642-31f2-4c79-b0bd-a7c31ae62e77\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.570611 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.570591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/13841642-31f2-4c79-b0bd-a7c31ae62e77-test-realms\") pod \"maas-keycloak-0\" (UID: \"13841642-31f2-4c79-b0bd-a7c31ae62e77\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.579342 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.579317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbj5r\" (UniqueName: \"kubernetes.io/projected/13841642-31f2-4c79-b0bd-a7c31ae62e77-kube-api-access-wbj5r\") pod \"maas-keycloak-0\" (UID: \"13841642-31f2-4c79-b0bd-a7c31ae62e77\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.609214 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.609180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:39.752169 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.752142 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:17:39.754873 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:17:39.754842 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13841642_31f2_4c79_b0bd_a7c31ae62e77.slice/crio-e661d9de00ba76941c811a7eddb2c131c487a892af27ff0608f77e6496385c33 WatchSource:0}: Error finding container e661d9de00ba76941c811a7eddb2c131c487a892af27ff0608f77e6496385c33: Status 404 returned error can't find the container with id e661d9de00ba76941c811a7eddb2c131c487a892af27ff0608f77e6496385c33 Jun 11 15:17:39.756230 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:39.756212 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:17:40.250377 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:40.250345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"13841642-31f2-4c79-b0bd-a7c31ae62e77","Type":"ContainerStarted","Data":"9f4ef39bf9ae2088f0f65d90e299a4b724ae214b1632b6032686dfc1b03d3bb2"} Jun 11 15:17:40.250857 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:40.250396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"13841642-31f2-4c79-b0bd-a7c31ae62e77","Type":"ContainerStarted","Data":"e661d9de00ba76941c811a7eddb2c131c487a892af27ff0608f77e6496385c33"} Jun 11 15:17:40.270360 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:40.270298 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.903907969 podStartE2EDuration="1.27027519s" totalImagesPullingTime="366.367221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:40.269518978 +0000 UTC m=+737.387010895" watchObservedRunningTime="2026-06-11 15:17:40.27027519 +0000 UTC m=+737.387767108" Jun 11 15:17:40.609694 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:40.609641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:40.611828 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:40.611755 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:41.610655 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:41.610605 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:42.610817 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:42.610753 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:43.610549 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:43.610494 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:44.610222 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:44.610171 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:45.610496 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:45.610450 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:46.610767 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:46.610717 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:47.610597 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:47.610548 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:48.610366 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:48.610310 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:49.610231 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:49.610187 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:49.610550 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:49.610510 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:50.610381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:50.610331 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:51.610166 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:51.610120 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:52.610415 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:52.610361 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 15:17:53.716897 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:53.716865 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:17:53.732557 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:17:53.732503 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="13841642-31f2-4c79-b0bd-a7c31ae62e77" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:18:03.723701 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:03.723660 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:18:27.986750 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:27.986712 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht"] Jun 11 15:18:27.990250 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:27.990221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:27.993260 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:27.993231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jt5g7\"" Jun 11 15:18:27.993405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:27.993277 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 15:18:27.993405 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:27.993278 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 15:18:27.993549 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:27.993278 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 15:18:28.009294 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.009267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht"] Jun 11 15:18:28.090607 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.090570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k588t\" (UniqueName: \"kubernetes.io/projected/c91d3f8f-184e-4e6b-b619-4f3189432edf-kube-api-access-k588t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.090789 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.090621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.090980 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.090840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91d3f8f-184e-4e6b-b619-4f3189432edf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.090980 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.090900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.091052 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.091020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.091091 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.091053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192334 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192538 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91d3f8f-184e-4e6b-b619-4f3189432edf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192538 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192538 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192538 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192538 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k588t\" (UniqueName: \"kubernetes.io/projected/c91d3f8f-184e-4e6b-b619-4f3189432edf-kube-api-access-k588t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192835 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192910 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.192910 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.192898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.194960 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.194938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c91d3f8f-184e-4e6b-b619-4f3189432edf-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.195235 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.195214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c91d3f8f-184e-4e6b-b619-4f3189432edf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.202426 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.202393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k588t\" (UniqueName: \"kubernetes.io/projected/c91d3f8f-184e-4e6b-b619-4f3189432edf-kube-api-access-k588t\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht\" (UID: \"c91d3f8f-184e-4e6b-b619-4f3189432edf\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.303726 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.303683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:28.457262 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.457231 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht"] Jun 11 15:18:28.460539 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:18:28.460509 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91d3f8f_184e_4e6b_b619_4f3189432edf.slice/crio-d312663de3e19a7bffe0f99140e3fb1697e5a0ffb9668e0a3b7aa41d3f9d79ec WatchSource:0}: Error finding container d312663de3e19a7bffe0f99140e3fb1697e5a0ffb9668e0a3b7aa41d3f9d79ec: Status 404 returned error can't find the container with id d312663de3e19a7bffe0f99140e3fb1697e5a0ffb9668e0a3b7aa41d3f9d79ec Jun 11 15:18:28.578762 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:28.578667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" event={"ID":"c91d3f8f-184e-4e6b-b619-4f3189432edf","Type":"ContainerStarted","Data":"d312663de3e19a7bffe0f99140e3fb1697e5a0ffb9668e0a3b7aa41d3f9d79ec"} Jun 11 15:18:32.605388 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:32.605325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" event={"ID":"c91d3f8f-184e-4e6b-b619-4f3189432edf","Type":"ContainerStarted","Data":"cc99753fc5cefe197210c5c2e8b47f4ebc590e967e9eb8fb53ef669d39c90c0d"} Jun 11 15:18:33.612591 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:33.612560 2576 generic.go:356] "Generic (PLEG): container finished" podID="c91d3f8f-184e-4e6b-b619-4f3189432edf" containerID="cc99753fc5cefe197210c5c2e8b47f4ebc590e967e9eb8fb53ef669d39c90c0d" exitCode=0 Jun 11 15:18:33.613001 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:33.612632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" event={"ID":"c91d3f8f-184e-4e6b-b619-4f3189432edf","Type":"ContainerDied","Data":"cc99753fc5cefe197210c5c2e8b47f4ebc590e967e9eb8fb53ef669d39c90c0d"} Jun 11 15:18:35.626365 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:35.626327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" event={"ID":"c91d3f8f-184e-4e6b-b619-4f3189432edf","Type":"ContainerStarted","Data":"0563240fb0653f7008d6f65d58d5d046a516e7d3cd84e995d9ace060f5b887bf"} Jun 11 15:18:35.644941 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:35.644881 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" podStartSLOduration=2.67587419 podStartE2EDuration="8.644861854s" totalImagesPullingTime="4.618038624s" totalInitContainerRuntime="1.35094904s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:18:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:35.643770976 +0000 UTC m=+792.761262913" watchObservedRunningTime="2026-06-11 15:18:35.644861854 +0000 UTC m=+792.762353770" Jun 11 15:18:38.304684 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:38.304636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:38.305155 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:38.304712 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:38.317363 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:38.317334 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:38.658596 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:38.658497 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht" Jun 11 15:18:45.105780 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.105746 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms"] Jun 11 15:18:45.113390 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.113369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.115990 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.115964 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 15:18:45.122092 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.122066 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms"] Jun 11 15:18:45.170357 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.170321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.170513 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.170361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trblx\" (UniqueName: \"kubernetes.io/projected/cbb68e74-3020-4e4c-a591-271aee57d864-kube-api-access-trblx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.170513 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.170388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.170513 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.170481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb68e74-3020-4e4c-a591-271aee57d864-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.170513 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.170511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.170655 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.170577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.271234 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.271199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.271552 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.271510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb68e74-3020-4e4c-a591-271aee57d864-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.271682 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.271666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.271821 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.271788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.271990 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.271976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.272102 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.272086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trblx\" (UniqueName: \"kubernetes.io/projected/cbb68e74-3020-4e4c-a591-271aee57d864-kube-api-access-trblx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.272297 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.272272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.272834 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.272792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.273023 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.273005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.285011 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.284938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbb68e74-3020-4e4c-a591-271aee57d864-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.292108 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.292024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trblx\" (UniqueName: \"kubernetes.io/projected/cbb68e74-3020-4e4c-a591-271aee57d864-kube-api-access-trblx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.305532 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.305445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbb68e74-3020-4e4c-a591-271aee57d864-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms\" (UID: \"cbb68e74-3020-4e4c-a591-271aee57d864\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.425147 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.425057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:45.571038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.571009 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms"] Jun 11 15:18:45.573602 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:18:45.573574 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb68e74_3020_4e4c_a591_271aee57d864.slice/crio-67502d93c4ba28164d3833c567ab541acc6d70113a7638c4078ced548c054177 WatchSource:0}: Error finding container 67502d93c4ba28164d3833c567ab541acc6d70113a7638c4078ced548c054177: Status 404 returned error can't find the container with id 67502d93c4ba28164d3833c567ab541acc6d70113a7638c4078ced548c054177 Jun 11 15:18:45.685701 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.685612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" event={"ID":"cbb68e74-3020-4e4c-a591-271aee57d864","Type":"ContainerStarted","Data":"a61831df3b6bf92167d1d33d55aa89f81caabcddb6318233f50351a6977448e4"} Jun 11 15:18:45.685701 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:45.685667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" event={"ID":"cbb68e74-3020-4e4c-a591-271aee57d864","Type":"ContainerStarted","Data":"67502d93c4ba28164d3833c567ab541acc6d70113a7638c4078ced548c054177"} Jun 11 15:18:47.698119 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:47.698080 2576 generic.go:356] "Generic (PLEG): container finished" podID="cbb68e74-3020-4e4c-a591-271aee57d864" containerID="a61831df3b6bf92167d1d33d55aa89f81caabcddb6318233f50351a6977448e4" exitCode=0 Jun 11 15:18:47.698481 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:47.698155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" event={"ID":"cbb68e74-3020-4e4c-a591-271aee57d864","Type":"ContainerDied","Data":"a61831df3b6bf92167d1d33d55aa89f81caabcddb6318233f50351a6977448e4"} Jun 11 15:18:48.705061 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:48.705032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" event={"ID":"cbb68e74-3020-4e4c-a591-271aee57d864","Type":"ContainerStarted","Data":"205cca096bb3423d51d50fa6f6313560cc4192057f659973590fb52c9c056f3e"} Jun 11 15:18:48.730622 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:48.730558 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" podStartSLOduration=2.126329597 podStartE2EDuration="3.730540654s" totalImagesPullingTime="273.138833ms" totalInitContainerRuntime="1.331072224s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:48.727180061 +0000 UTC m=+805.844671976" watchObservedRunningTime="2026-06-11 15:18:48.730540654 +0000 UTC m=+805.848032570" Jun 11 15:18:55.425970 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:55.425927 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:55.426485 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:55.425984 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:55.438864 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:55.438834 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:18:55.755024 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:18:55.754937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms" Jun 11 15:22:14.887332 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:14.887297 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5978c9768d-xrgqb"] Jun 11 15:22:14.887879 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:14.887552 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5978c9768d-xrgqb" podUID="9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" containerName="manager" containerID="cri-o://c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617" gracePeriod=30 Jun 11 15:22:15.153774 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.153708 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:22:15.230492 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.230447 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-webhook-cert\") pod \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " Jun 11 15:22:15.230696 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.230519 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjs46\" (UniqueName: \"kubernetes.io/projected/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-kube-api-access-vjs46\") pod \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\" (UID: \"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055\") " Jun 11 15:22:15.232723 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.232693 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" (UID: "9833b6e4-c5a8-4046-aaf1-2e2acfdd4055"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:15.232875 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.232772 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-kube-api-access-vjs46" (OuterVolumeSpecName: "kube-api-access-vjs46") pod "9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" (UID: "9833b6e4-c5a8-4046-aaf1-2e2acfdd4055"). InnerVolumeSpecName "kube-api-access-vjs46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:15.331634 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.331603 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-webhook-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:22:15.331634 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.331630 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjs46\" (UniqueName: \"kubernetes.io/projected/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055-kube-api-access-vjs46\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:22:15.873870 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.873830 2576 generic.go:356] "Generic (PLEG): container finished" podID="9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" containerID="c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617" exitCode=0 Jun 11 15:22:15.873870 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.873885 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5978c9768d-xrgqb" Jun 11 15:22:15.874133 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.873926 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5978c9768d-xrgqb" event={"ID":"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055","Type":"ContainerDied","Data":"c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617"} Jun 11 15:22:15.874133 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.873976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5978c9768d-xrgqb" event={"ID":"9833b6e4-c5a8-4046-aaf1-2e2acfdd4055","Type":"ContainerDied","Data":"5cfc8f6ba9895e77bc08c08e237d7df26bd85225fe3776f5663914779fdbbc2c"} Jun 11 15:22:15.874133 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.873997 2576 scope.go:117] "RemoveContainer" containerID="c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617" Jun 11 15:22:15.884588 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.884569 2576 scope.go:117] "RemoveContainer" containerID="c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617" Jun 11 15:22:15.885862 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:22:15.885831 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617\": container with ID starting with c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617 not found: ID does not exist" containerID="c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617" Jun 11 15:22:15.885973 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.885870 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617"} err="failed to get container status \"c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617\": rpc error: code = NotFound desc = could not find container \"c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617\": container with ID starting with c559f144818b8898df6d1a177d2149d1d199131a0d8ed089e26e77439393e617 not found: ID does not exist" Jun 11 15:22:15.889848 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.889819 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5978c9768d-xrgqb"] Jun 11 15:22:15.895982 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:15.895957 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5978c9768d-xrgqb"] Jun 11 15:22:16.665794 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.665757 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5978c9768d-x8ts5"] Jun 11 15:22:16.666255 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.666241 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" containerName="manager" Jun 11 15:22:16.666300 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.666257 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" containerName="manager" Jun 11 15:22:16.666337 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.666332 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" containerName="manager" Jun 11 15:22:16.668936 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.668917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:16.671473 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.671452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5vvq\"" Jun 11 15:22:16.671604 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.671453 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 15:22:16.671604 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.671453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 15:22:16.679047 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.679023 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5978c9768d-x8ts5"] Jun 11 15:22:16.746179 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.746144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpgtn\" (UniqueName: \"kubernetes.io/projected/e914988a-b45b-4756-ae7b-503e160c41fc-kube-api-access-wpgtn\") pod \"maas-controller-5978c9768d-x8ts5\" (UID: \"e914988a-b45b-4756-ae7b-503e160c41fc\") " pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:16.746361 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.746185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e914988a-b45b-4756-ae7b-503e160c41fc-webhook-cert\") pod \"maas-controller-5978c9768d-x8ts5\" (UID: \"e914988a-b45b-4756-ae7b-503e160c41fc\") " pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:16.847031 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.846979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpgtn\" (UniqueName: \"kubernetes.io/projected/e914988a-b45b-4756-ae7b-503e160c41fc-kube-api-access-wpgtn\") pod \"maas-controller-5978c9768d-x8ts5\" (UID: \"e914988a-b45b-4756-ae7b-503e160c41fc\") " pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:16.847031 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.847036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e914988a-b45b-4756-ae7b-503e160c41fc-webhook-cert\") pod \"maas-controller-5978c9768d-x8ts5\" (UID: \"e914988a-b45b-4756-ae7b-503e160c41fc\") " pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:16.849649 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.849624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e914988a-b45b-4756-ae7b-503e160c41fc-webhook-cert\") pod \"maas-controller-5978c9768d-x8ts5\" (UID: \"e914988a-b45b-4756-ae7b-503e160c41fc\") " pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:16.856624 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.856600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpgtn\" (UniqueName: \"kubernetes.io/projected/e914988a-b45b-4756-ae7b-503e160c41fc-kube-api-access-wpgtn\") pod \"maas-controller-5978c9768d-x8ts5\" (UID: \"e914988a-b45b-4756-ae7b-503e160c41fc\") " pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:16.981571 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:16.981463 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:17.135637 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:17.135610 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5978c9768d-x8ts5"] Jun 11 15:22:17.138713 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:22:17.138684 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode914988a_b45b_4756_ae7b_503e160c41fc.slice/crio-c2d382378a5cb8840ed48ca8a384d413ec7c09d6cf159d879041473aa64f8ad8 WatchSource:0}: Error finding container c2d382378a5cb8840ed48ca8a384d413ec7c09d6cf159d879041473aa64f8ad8: Status 404 returned error can't find the container with id c2d382378a5cb8840ed48ca8a384d413ec7c09d6cf159d879041473aa64f8ad8 Jun 11 15:22:17.324324 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:17.324288 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9833b6e4-c5a8-4046-aaf1-2e2acfdd4055" path="/var/lib/kubelet/pods/9833b6e4-c5a8-4046-aaf1-2e2acfdd4055/volumes" Jun 11 15:22:17.887277 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:17.887179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5978c9768d-x8ts5" event={"ID":"e914988a-b45b-4756-ae7b-503e160c41fc","Type":"ContainerStarted","Data":"9e2739121dcc1d07bb898d41f517483983cccf403fe1aa2b480e5f703a1fcfc3"} Jun 11 15:22:17.887277 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:17.887242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5978c9768d-x8ts5" event={"ID":"e914988a-b45b-4756-ae7b-503e160c41fc","Type":"ContainerStarted","Data":"c2d382378a5cb8840ed48ca8a384d413ec7c09d6cf159d879041473aa64f8ad8"} Jun 11 15:22:17.887466 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:17.887363 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:22:17.913739 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:17.913689 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5978c9768d-x8ts5" podStartSLOduration=1.463688433 podStartE2EDuration="1.913669489s" totalImagesPullingTime="449.981056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:17.91286636 +0000 UTC m=+1015.030358278" watchObservedRunningTime="2026-06-11 15:22:17.913669489 +0000 UTC m=+1015.031161405" Jun 11 15:22:28.899027 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:22:28.898995 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5978c9768d-x8ts5" Jun 11 15:32:21.291463 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.291349 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc"] Jun 11 15:32:21.292203 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.291611 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" podUID="30af5cd0-4889-44bc-b596-8203d679d845" containerName="manager" containerID="cri-o://8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f" gracePeriod=10 Jun 11 15:32:21.565516 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.565479 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:32:21.691275 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.691238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs5vm\" (UniqueName: \"kubernetes.io/projected/30af5cd0-4889-44bc-b596-8203d679d845-kube-api-access-zs5vm\") pod \"30af5cd0-4889-44bc-b596-8203d679d845\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " Jun 11 15:32:21.691490 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.691409 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30af5cd0-4889-44bc-b596-8203d679d845-extensions-socket-volume\") pod \"30af5cd0-4889-44bc-b596-8203d679d845\" (UID: \"30af5cd0-4889-44bc-b596-8203d679d845\") " Jun 11 15:32:21.691857 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.691831 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30af5cd0-4889-44bc-b596-8203d679d845-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "30af5cd0-4889-44bc-b596-8203d679d845" (UID: "30af5cd0-4889-44bc-b596-8203d679d845"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:32:21.693976 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.693941 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30af5cd0-4889-44bc-b596-8203d679d845-kube-api-access-zs5vm" (OuterVolumeSpecName: "kube-api-access-zs5vm") pod "30af5cd0-4889-44bc-b596-8203d679d845" (UID: "30af5cd0-4889-44bc-b596-8203d679d845"). InnerVolumeSpecName "kube-api-access-zs5vm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:32:21.792407 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.792374 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs5vm\" (UniqueName: \"kubernetes.io/projected/30af5cd0-4889-44bc-b596-8203d679d845-kube-api-access-zs5vm\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:32:21.792407 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:21.792404 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30af5cd0-4889-44bc-b596-8203d679d845-extensions-socket-volume\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:32:22.315238 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.315203 2576 generic.go:356] "Generic (PLEG): container finished" podID="30af5cd0-4889-44bc-b596-8203d679d845" containerID="8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f" exitCode=0 Jun 11 15:32:22.315731 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.315255 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" Jun 11 15:32:22.315731 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.315301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" event={"ID":"30af5cd0-4889-44bc-b596-8203d679d845","Type":"ContainerDied","Data":"8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f"} Jun 11 15:32:22.315731 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.315367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc" event={"ID":"30af5cd0-4889-44bc-b596-8203d679d845","Type":"ContainerDied","Data":"aae7ae7b158b6945fc9ef656a99e6c1066b2b93521ec5e9e1342b91688089ff0"} Jun 11 15:32:22.315731 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.315403 2576 scope.go:117] "RemoveContainer" containerID="8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f" Jun 11 15:32:22.326439 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.326414 2576 scope.go:117] "RemoveContainer" containerID="8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f" Jun 11 15:32:22.326836 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:32:22.326789 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f\": container with ID starting with 8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f not found: ID does not exist" containerID="8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f" Jun 11 15:32:22.326890 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.326846 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f"} err="failed to get container status \"8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f\": rpc error: code = NotFound desc = could not find container \"8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f\": container with ID starting with 8d77f0a375a4ff04469b442db3d9e34826a6b9d6357a7152a228b2afd5883e0f not found: ID does not exist" Jun 11 15:32:22.343864 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.343787 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc"] Jun 11 15:32:22.346641 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:22.346601 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5bpc"] Jun 11 15:32:23.326709 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:32:23.326669 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30af5cd0-4889-44bc-b596-8203d679d845" path="/var/lib/kubelet/pods/30af5cd0-4889-44bc-b596-8203d679d845/volumes" Jun 11 15:33:27.500325 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.500285 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4"] Jun 11 15:33:27.503030 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.500970 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30af5cd0-4889-44bc-b596-8203d679d845" containerName="manager" Jun 11 15:33:27.503030 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.500987 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="30af5cd0-4889-44bc-b596-8203d679d845" containerName="manager" Jun 11 15:33:27.503030 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.501064 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="30af5cd0-4889-44bc-b596-8203d679d845" containerName="manager" Jun 11 15:33:27.504127 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.504106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.507770 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.507753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tjrzb\"" Jun 11 15:33:27.515598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.515569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4"] Jun 11 15:33:27.578154 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.578118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a937f4-f455-4a5e-97b7-0a2636994b5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wk9l4\" (UID: \"c4a937f4-f455-4a5e-97b7-0a2636994b5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.578346 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.578165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svwjb\" (UniqueName: \"kubernetes.io/projected/c4a937f4-f455-4a5e-97b7-0a2636994b5a-kube-api-access-svwjb\") pod \"kuadrant-operator-controller-manager-86878c769f-wk9l4\" (UID: \"c4a937f4-f455-4a5e-97b7-0a2636994b5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.678995 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.678962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a937f4-f455-4a5e-97b7-0a2636994b5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wk9l4\" (UID: \"c4a937f4-f455-4a5e-97b7-0a2636994b5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.679194 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.679004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svwjb\" (UniqueName: \"kubernetes.io/projected/c4a937f4-f455-4a5e-97b7-0a2636994b5a-kube-api-access-svwjb\") pod \"kuadrant-operator-controller-manager-86878c769f-wk9l4\" (UID: \"c4a937f4-f455-4a5e-97b7-0a2636994b5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.679402 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.679379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a937f4-f455-4a5e-97b7-0a2636994b5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wk9l4\" (UID: \"c4a937f4-f455-4a5e-97b7-0a2636994b5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.688634 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.688608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svwjb\" (UniqueName: \"kubernetes.io/projected/c4a937f4-f455-4a5e-97b7-0a2636994b5a-kube-api-access-svwjb\") pod \"kuadrant-operator-controller-manager-86878c769f-wk9l4\" (UID: \"c4a937f4-f455-4a5e-97b7-0a2636994b5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.815362 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.815326 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:27.961778 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:27.961751 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4"] Jun 11 15:33:27.967281 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:33:27.966939 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a937f4_f455_4a5e_97b7_0a2636994b5a.slice/crio-1493089068c8cb076067ae1df44465b7f34777e183bf3cfc928ad5dad9ecccf9 WatchSource:0}: Error finding container 1493089068c8cb076067ae1df44465b7f34777e183bf3cfc928ad5dad9ecccf9: Status 404 returned error can't find the container with id 1493089068c8cb076067ae1df44465b7f34777e183bf3cfc928ad5dad9ecccf9 Jun 11 15:33:28.682638 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:28.682603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" event={"ID":"c4a937f4-f455-4a5e-97b7-0a2636994b5a","Type":"ContainerStarted","Data":"c65099415b31155d2d82430ffdec5942dd48c1a8efe6a447a990ece1eedfc63d"} Jun 11 15:33:28.683051 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:28.682664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" event={"ID":"c4a937f4-f455-4a5e-97b7-0a2636994b5a","Type":"ContainerStarted","Data":"1493089068c8cb076067ae1df44465b7f34777e183bf3cfc928ad5dad9ecccf9"} Jun 11 15:33:28.683051 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:28.682690 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:33:28.709274 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:28.709227 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" podStartSLOduration=1.709209799 podStartE2EDuration="1.709209799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:33:28.706964336 +0000 UTC m=+1685.824456276" watchObservedRunningTime="2026-06-11 15:33:28.709209799 +0000 UTC m=+1685.826701717" Jun 11 15:33:39.691642 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:33:39.691610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wk9l4" Jun 11 15:43:10.764184 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.764145 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r"] Jun 11 15:43:10.768194 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.768168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.771396 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.771373 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c8e48d31-openshift-default-dockercfg-rhzc2\"" Jun 11 15:43:10.795088 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.795052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r"] Jun 11 15:43:10.864106 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-token\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864106 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-data\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istiod-ca-cert\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-envoy\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-credential-socket\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864381 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-certs\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864606 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-podinfo\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864606 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wmw9\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-kube-api-access-6wmw9\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.864606 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.864580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-socket\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-socket\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965517 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-token\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-data\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istiod-ca-cert\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-envoy\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-credential-socket\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-certs\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-podinfo\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.965858 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.965851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wmw9\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-kube-api-access-6wmw9\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.966232 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.966050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-data\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.966232 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.966175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-socket\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.966417 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.966389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istiod-ca-cert\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.966552 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.966425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-certs\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.966605 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.966564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-credential-socket\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.968725 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.968699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-podinfo\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.968878 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.968752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-envoy\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.988309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.988271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-token\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:10.989741 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:10.989707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wmw9\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-kube-api-access-6wmw9\") pod \"e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:11.080168 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:11.080062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:11.262845 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:11.262233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r"] Jun 11 15:43:11.267225 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:11.266429 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:43:11.267225 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:11.266565 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:43:11.267225 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:11.266650 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 11 15:43:11.979167 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:11.979128 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" event={"ID":"07e08948-3f30-4a0c-9a9c-aa5b9be23119","Type":"ContainerStarted","Data":"4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4"} Jun 11 15:43:11.979570 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:11.979185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" event={"ID":"07e08948-3f30-4a0c-9a9c-aa5b9be23119","Type":"ContainerStarted","Data":"7695bfc386c6cbf7a5d3a898909eb4e1a2cbed298f3f83a955522ca2cf4f0396"} Jun 11 15:43:12.005172 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:12.005114 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" podStartSLOduration=2.005093224 podStartE2EDuration="2.005093224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:43:12.002789871 +0000 UTC m=+2269.120281786" watchObservedRunningTime="2026-06-11 15:43:12.005093224 +0000 UTC m=+2269.122585139" Jun 11 15:43:12.080753 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:12.080717 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:12.085919 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:12.085895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:12.985141 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:12.985112 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:12.986176 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:12.986157 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:18.283660 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:18.283619 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r"] Jun 11 15:43:18.284098 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:18.283881 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" podUID="07e08948-3f30-4a0c-9a9c-aa5b9be23119" containerName="istio-proxy" containerID="cri-o://4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4" gracePeriod=30 Jun 11 15:43:23.548377 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.548308 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:23.702249 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702222 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-certs\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702249 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-credential-socket\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702464 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702331 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istiod-ca-cert\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702464 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702355 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-envoy\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702464 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702415 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-data\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702464 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702462 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-podinfo\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702495 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wmw9\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-kube-api-access-6wmw9\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702494 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:43:23.702668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702519 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-socket\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702554 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-token\") pod \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\" (UID: \"07e08948-3f30-4a0c-9a9c-aa5b9be23119\") " Jun 11 15:43:23.702668 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702604 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:43:23.702990 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702705 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-data" (OuterVolumeSpecName: "istio-data") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:43:23.702990 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702713 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:43:23.702990 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702748 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:43:23.703131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.702993 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istiod-ca-cert\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.703131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.703013 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-data\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.703131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.703027 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-socket\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.703131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.703040 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-workload-certs\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.703131 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.703053 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-credential-socket\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.704816 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.704775 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:43:23.705820 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.705014 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-kube-api-access-6wmw9" (OuterVolumeSpecName: "kube-api-access-6wmw9") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "kube-api-access-6wmw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:43:23.705820 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.705276 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-token" (OuterVolumeSpecName: "istio-token") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:43:23.705820 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.705331 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07e08948-3f30-4a0c-9a9c-aa5b9be23119" (UID: "07e08948-3f30-4a0c-9a9c-aa5b9be23119"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 15:43:23.804439 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.804341 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-podinfo\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.804439 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.804374 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wmw9\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-kube-api-access-6wmw9\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.804439 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.804385 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-token\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:23.804439 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:23.804393 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e08948-3f30-4a0c-9a9c-aa5b9be23119-istio-envoy\") on node \"ip-10-0-136-38.ec2.internal\" DevicePath \"\"" Jun 11 15:43:24.055604 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.055500 2576 generic.go:356] "Generic (PLEG): container finished" podID="07e08948-3f30-4a0c-9a9c-aa5b9be23119" containerID="4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4" exitCode=0 Jun 11 15:43:24.055604 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.055540 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" Jun 11 15:43:24.055604 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.055582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" event={"ID":"07e08948-3f30-4a0c-9a9c-aa5b9be23119","Type":"ContainerDied","Data":"4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4"} Jun 11 15:43:24.055919 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.055634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r" event={"ID":"07e08948-3f30-4a0c-9a9c-aa5b9be23119","Type":"ContainerDied","Data":"7695bfc386c6cbf7a5d3a898909eb4e1a2cbed298f3f83a955522ca2cf4f0396"} Jun 11 15:43:24.055919 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.055657 2576 scope.go:117] "RemoveContainer" containerID="4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4" Jun 11 15:43:24.065842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.065822 2576 scope.go:117] "RemoveContainer" containerID="4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4" Jun 11 15:43:24.066156 ip-10-0-136-38 kubenswrapper[2576]: E0611 15:43:24.066137 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4\": container with ID starting with 4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4 not found: ID does not exist" containerID="4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4" Jun 11 15:43:24.066221 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.066163 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4"} err="failed to get container status \"4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4\": rpc error: code = NotFound desc = could not find container \"4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4\": container with ID starting with 4d85a1f6b3c41835f8657f932b60ee617ad41724228610af777e53f5432f3ba4 not found: ID does not exist" Jun 11 15:43:24.080077 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.080042 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r"] Jun 11 15:43:24.088403 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:24.088378 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c8e48d31-openshift-default-69555c69d-4ml5r"] Jun 11 15:43:25.324231 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:25.324196 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e08948-3f30-4a0c-9a9c-aa5b9be23119" path="/var/lib/kubelet/pods/07e08948-3f30-4a0c-9a9c-aa5b9be23119/volumes" Jun 11 15:43:35.745232 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:35.745191 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69669f6f8f-8zcmr_0f9467d7-345e-41ac-92da-58caf5550967/nginx/0.log" Jun 11 15:43:36.106849 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:36.106819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d88fb877f-n5jpv_5dd8f21e-ef1e-403e-8932-54f5354c53c4/maas-api/0.log" Jun 11 15:43:36.339199 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:36.339161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5978c9768d-x8ts5_e914988a-b45b-4756-ae7b-503e160c41fc/manager/0.log" Jun 11 15:43:36.973644 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:36.973615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f75ddbfd7-lvx9f_2d79e32b-af07-42b1-b2be-15f5732eec1b/copy-manifests/0.log" Jun 11 15:43:36.993691 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:36.993661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f75ddbfd7-lvx9f_2d79e32b-af07-42b1-b2be-15f5732eec1b/manager/0.log" Jun 11 15:43:38.581205 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:38.581176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tp4q9_29cdd26e-70d0-4666-949c-9df9449af8a8/manager/0.log" Jun 11 15:43:38.715935 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:38.715902 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-shgw4_e4e16959-9d62-4db9-b79a-86d60d777e5f/manager/0.log" Jun 11 15:43:38.958152 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:38.958074 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kdvw9_012f4241-efba-4079-bbe8-afce24720caa/registry-server/0.log" Jun 11 15:43:39.105038 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:39.105005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wk9l4_c4a937f4-f455-4a5e-97b7-0a2636994b5a/manager/0.log" Jun 11 15:43:39.778486 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:39.778455 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-677b9b985557n4s_f13ad83a-8355-4f9a-b5e3-ae9c4c13162c/istio-proxy/0.log" Jun 11 15:43:40.235421 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:40.235347 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7c4d88f86d-697nx_6d0a5ce7-0dd4-4cc4-987c-27688381f981/istio-proxy/1.log" Jun 11 15:43:40.363566 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:40.363533 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gqk6h_9e916930-703d-49e8-a96f-ed214d3fcba2/payload-pre-processing/0.log" Jun 11 15:43:40.494237 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:40.494161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-l7sml_41e93811-b6e2-40c0-87a7-68bf18e4618d/payload-processing/0.log" Jun 11 15:43:40.956615 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:40.956586 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht_c91d3f8f-184e-4e6b-b619-4f3189432edf/storage-initializer/0.log" Jun 11 15:43:40.965090 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:40.965067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-j8nht_c91d3f8f-184e-4e6b-b619-4f3189432edf/main/0.log" Jun 11 15:43:41.204086 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:41.204047 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms_cbb68e74-3020-4e4c-a591-271aee57d864/storage-initializer/0.log" Jun 11 15:43:41.215331 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:41.215255 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ms5ms_cbb68e74-3020-4e4c-a591-271aee57d864/main/0.log" Jun 11 15:43:49.083823 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:49.083773 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-twzmn_f5c1ea86-0ac1-4516-bdaf-28a71a1c3f32/global-pull-secret-syncer/0.log" Jun 11 15:43:49.178320 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:49.178292 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jjgp5_854ff2b6-eb12-4d4d-b1af-04343ec3bfcb/konnectivity-agent/0.log" Jun 11 15:43:49.245124 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:49.245095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-38.ec2.internal_cfea306d350844199848c9bdf4cc30f8/haproxy/0.log" Jun 11 15:43:53.664192 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:53.664161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tp4q9_29cdd26e-70d0-4666-949c-9df9449af8a8/manager/0.log" Jun 11 15:43:53.700918 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:53.700889 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-shgw4_e4e16959-9d62-4db9-b79a-86d60d777e5f/manager/0.log" Jun 11 15:43:53.782619 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:53.782573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kdvw9_012f4241-efba-4079-bbe8-afce24720caa/registry-server/0.log" Jun 11 15:43:53.882334 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:53.882249 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wk9l4_c4a937f4-f455-4a5e-97b7-0a2636994b5a/manager/0.log" Jun 11 15:43:55.684842 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:55.684794 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce59895b-a6cc-448e-93dc-ffc7bcc27c8d/alertmanager/0.log" Jun 11 15:43:55.717761 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:55.717733 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce59895b-a6cc-448e-93dc-ffc7bcc27c8d/config-reloader/0.log" Jun 11 15:43:55.754358 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:55.754315 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce59895b-a6cc-448e-93dc-ffc7bcc27c8d/kube-rbac-proxy-web/0.log" Jun 11 15:43:55.784386 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:55.784349 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce59895b-a6cc-448e-93dc-ffc7bcc27c8d/kube-rbac-proxy/0.log" Jun 11 15:43:55.821082 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:55.821054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce59895b-a6cc-448e-93dc-ffc7bcc27c8d/kube-rbac-proxy-metric/0.log" Jun 11 15:43:55.874453 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:55.874425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce59895b-a6cc-448e-93dc-ffc7bcc27c8d/prom-label-proxy/0.log" Jun 11 15:43:55.972603 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:55.972575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce59895b-a6cc-448e-93dc-ffc7bcc27c8d/init-config-reloader/0.log" Jun 11 15:43:56.083562 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.083531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bndwm_1bbe7090-499b-4966-82f2-c5ce702bf00f/kube-state-metrics/0.log" Jun 11 15:43:56.115779 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.115753 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bndwm_1bbe7090-499b-4966-82f2-c5ce702bf00f/kube-rbac-proxy-main/0.log" Jun 11 15:43:56.145932 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.145908 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bndwm_1bbe7090-499b-4966-82f2-c5ce702bf00f/kube-rbac-proxy-self/0.log" Jun 11 15:43:56.187936 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.187909 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7fcbc4789d-7vl2r_2318b100-5e3c-430a-b3db-f96b629b851b/metrics-server/0.log" Jun 11 15:43:56.235170 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.235076 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kvdgh_39808e83-f545-4bcd-a17a-22c1b0a0fbcc/monitoring-plugin/0.log" Jun 11 15:43:56.275990 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.275961 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2z29_01f06959-67c5-49ac-80f3-273b9629122b/node-exporter/0.log" Jun 11 15:43:56.301759 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.301730 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2z29_01f06959-67c5-49ac-80f3-273b9629122b/kube-rbac-proxy/0.log" Jun 11 15:43:56.332193 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.332170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2z29_01f06959-67c5-49ac-80f3-273b9629122b/init-textfile/0.log" Jun 11 15:43:56.573001 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.572958 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7b65j_8fcc7554-8e3e-4731-9e83-4d6e221284b5/kube-rbac-proxy-main/0.log" Jun 11 15:43:56.609495 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.609461 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7b65j_8fcc7554-8e3e-4731-9e83-4d6e221284b5/kube-rbac-proxy-self/0.log" Jun 11 15:43:56.658707 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.658680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7b65j_8fcc7554-8e3e-4731-9e83-4d6e221284b5/openshift-state-metrics/0.log" Jun 11 15:43:56.754292 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.754259 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b54d0b7a-be19-4fb9-bb6a-650035c75657/prometheus/0.log" Jun 11 15:43:56.798285 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.798252 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b54d0b7a-be19-4fb9-bb6a-650035c75657/config-reloader/0.log" Jun 11 15:43:56.881549 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.881468 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b54d0b7a-be19-4fb9-bb6a-650035c75657/thanos-sidecar/0.log" Jun 11 15:43:56.932530 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.932501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b54d0b7a-be19-4fb9-bb6a-650035c75657/kube-rbac-proxy-web/0.log" Jun 11 15:43:56.970169 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:56.970143 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b54d0b7a-be19-4fb9-bb6a-650035c75657/kube-rbac-proxy/0.log" Jun 11 15:43:57.004547 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.004519 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b54d0b7a-be19-4fb9-bb6a-650035c75657/kube-rbac-proxy-thanos/0.log" Jun 11 15:43:57.038598 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.038573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b54d0b7a-be19-4fb9-bb6a-650035c75657/init-config-reloader/0.log" Jun 11 15:43:57.204333 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.204249 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-694cd9f5b5-nht6c_dca7e6c9-4f48-4ca9-b439-22c49b9cb73a/telemeter-client/0.log" Jun 11 15:43:57.232372 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.232346 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-694cd9f5b5-nht6c_dca7e6c9-4f48-4ca9-b439-22c49b9cb73a/reload/0.log" Jun 11 15:43:57.262727 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.262696 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-694cd9f5b5-nht6c_dca7e6c9-4f48-4ca9-b439-22c49b9cb73a/kube-rbac-proxy/0.log" Jun 11 15:43:57.304309 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.304256 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bd8686f8-9kc48_15878bfd-d9db-417e-8122-262f8b8674cd/thanos-query/0.log" Jun 11 15:43:57.345111 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.345069 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bd8686f8-9kc48_15878bfd-d9db-417e-8122-262f8b8674cd/kube-rbac-proxy-web/0.log" Jun 11 15:43:57.383187 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.383161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bd8686f8-9kc48_15878bfd-d9db-417e-8122-262f8b8674cd/kube-rbac-proxy/0.log" Jun 11 15:43:57.408516 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.408485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bd8686f8-9kc48_15878bfd-d9db-417e-8122-262f8b8674cd/prom-label-proxy/0.log" Jun 11 15:43:57.444412 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.444386 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bd8686f8-9kc48_15878bfd-d9db-417e-8122-262f8b8674cd/kube-rbac-proxy-rules/0.log" Jun 11 15:43:57.476968 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:43:57.476881 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bd8686f8-9kc48_15878bfd-d9db-417e-8122-262f8b8674cd/kube-rbac-proxy-metrics/0.log" Jun 11 15:44:00.206352 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.206321 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69ff47d4fb-d9r5g_e07463fd-5c37-4407-84df-f4ca7227b209/console/0.log" Jun 11 15:44:00.256620 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.256589 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md"] Jun 11 15:44:00.257280 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.257258 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e08948-3f30-4a0c-9a9c-aa5b9be23119" containerName="istio-proxy" Jun 11 15:44:00.257280 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.257274 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e08948-3f30-4a0c-9a9c-aa5b9be23119" containerName="istio-proxy" Jun 11 15:44:00.257454 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.257348 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e08948-3f30-4a0c-9a9c-aa5b9be23119" containerName="istio-proxy" Jun 11 15:44:00.260886 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.260869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.262305 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.262286 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-rkt8q_b0643eb0-5d90-429a-9226-10a6a9bb41fa/download-server/0.log" Jun 11 15:44:00.263711 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.263692 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5bgk\"/\"kube-root-ca.crt\"" Jun 11 15:44:00.263828 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.263756 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5bgk\"/\"openshift-service-ca.crt\"" Jun 11 15:44:00.264639 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.264624 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f5bgk\"/\"default-dockercfg-zqr9t\"" Jun 11 15:44:00.272139 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.272117 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md"] Jun 11 15:44:00.388515 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.388481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-sys\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.388694 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.388520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-proc\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.388694 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.388553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-podres\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.388694 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.388636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-lib-modules\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.388834 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.388711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4sl\" (UniqueName: \"kubernetes.io/projected/de33c9f3-e36e-4205-ac12-c30b0b8244e4-kube-api-access-sd4sl\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490039 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.489947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4sl\" (UniqueName: \"kubernetes.io/projected/de33c9f3-e36e-4205-ac12-c30b0b8244e4-kube-api-access-sd4sl\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490039 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-sys\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490268 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-proc\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490268 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-proc\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490268 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-podres\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490268 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-lib-modules\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-podres\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-sys\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.490447 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.490400 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de33c9f3-e36e-4205-ac12-c30b0b8244e4-lib-modules\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.498679 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.498650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4sl\" (UniqueName: \"kubernetes.io/projected/de33c9f3-e36e-4205-ac12-c30b0b8244e4-kube-api-access-sd4sl\") pod \"perf-node-gather-daemonset-rr2md\" (UID: \"de33c9f3-e36e-4205-ac12-c30b0b8244e4\") " pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.572925 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.572892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:00.720545 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:00.720504 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md"] Jun 11 15:44:00.723091 ip-10-0-136-38 kubenswrapper[2576]: W0611 15:44:00.723060 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde33c9f3_e36e_4205_ac12_c30b0b8244e4.slice/crio-ba5cc66a6b19fd32384ce72b5d63cf77f73741c4cc02b30f9442ad17070cee8b WatchSource:0}: Error finding container ba5cc66a6b19fd32384ce72b5d63cf77f73741c4cc02b30f9442ad17070cee8b: Status 404 returned error can't find the container with id ba5cc66a6b19fd32384ce72b5d63cf77f73741c4cc02b30f9442ad17070cee8b Jun 11 15:44:01.036537 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:01.036502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-tqp59_2f54e9a5-e116-4f98-9096-73592e8a08e8/volume-data-source-validator/0.log" Jun 11 15:44:01.260530 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:01.260496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" event={"ID":"de33c9f3-e36e-4205-ac12-c30b0b8244e4","Type":"ContainerStarted","Data":"d019ea4324d1150cb45ceb2074f1c29001431c89e270d5cf3a7eb1e9904684f1"} Jun 11 15:44:01.260964 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:01.260552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" event={"ID":"de33c9f3-e36e-4205-ac12-c30b0b8244e4","Type":"ContainerStarted","Data":"ba5cc66a6b19fd32384ce72b5d63cf77f73741c4cc02b30f9442ad17070cee8b"} Jun 11 15:44:01.260964 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:01.260577 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:01.278627 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:01.278546 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" podStartSLOduration=1.27852827 podStartE2EDuration="1.27852827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:44:01.278077426 +0000 UTC m=+2318.395569338" watchObservedRunningTime="2026-06-11 15:44:01.27852827 +0000 UTC m=+2318.396020188" Jun 11 15:44:02.277535 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:02.277508 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vg56_98c5ab4c-7d81-4f98-bb75-0b3008f7939e/dns/0.log" Jun 11 15:44:02.311235 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:02.311206 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vg56_98c5ab4c-7d81-4f98-bb75-0b3008f7939e/kube-rbac-proxy/0.log" Jun 11 15:44:02.484724 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:02.484698 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z5sbv_5686dd6e-a8a0-4bf5-9253-4cf0b02a1f75/dns-node-resolver/0.log" Jun 11 15:44:03.131371 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:03.131341 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gspjf_fd6407d6-55b8-412b-a1ac-bd64d6c88938/node-ca/0.log" Jun 11 15:44:04.237633 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:04.237604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-677b9b985557n4s_f13ad83a-8355-4f9a-b5e3-ae9c4c13162c/istio-proxy/0.log" Jun 11 15:44:04.424541 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:04.424512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7c4d88f86d-697nx_6d0a5ce7-0dd4-4cc4-987c-27688381f981/istio-proxy/0.log" Jun 11 15:44:04.455331 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:04.455304 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7c4d88f86d-697nx_6d0a5ce7-0dd4-4cc4-987c-27688381f981/istio-proxy/1.log" Jun 11 15:44:04.499410 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:04.499335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gqk6h_9e916930-703d-49e8-a96f-ed214d3fcba2/payload-pre-processing/0.log" Jun 11 15:44:04.571370 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:04.571302 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-l7sml_41e93811-b6e2-40c0-87a7-68bf18e4618d/payload-processing/0.log" Jun 11 15:44:05.336784 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:05.336758 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9qkdn_64607fb3-845e-4e7b-8698-7091faa7e8dc/serve-healthcheck-canary/0.log" Jun 11 15:44:05.980365 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:05.980336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-v9gc6_7237fe16-998f-480c-ad41-0708dc5e5bba/insights-operator/0.log" Jun 11 15:44:05.980822 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:05.980779 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-v9gc6_7237fe16-998f-480c-ad41-0708dc5e5bba/insights-operator/1.log" Jun 11 15:44:06.185224 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:06.185196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvtcz_865e4df2-1b19-424d-ab92-0df8813a9c9a/kube-rbac-proxy/0.log" Jun 11 15:44:06.215820 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:06.215768 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvtcz_865e4df2-1b19-424d-ab92-0df8813a9c9a/exporter/0.log" Jun 11 15:44:06.248558 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:06.248490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvtcz_865e4df2-1b19-424d-ab92-0df8813a9c9a/extractor/0.log" Jun 11 15:44:07.276349 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:07.276319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f5bgk/perf-node-gather-daemonset-rr2md" Jun 11 15:44:08.770557 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:08.770531 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69669f6f8f-8zcmr_0f9467d7-345e-41ac-92da-58caf5550967/nginx/0.log" Jun 11 15:44:08.964486 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:08.964449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d88fb877f-n5jpv_5dd8f21e-ef1e-403e-8932-54f5354c53c4/maas-api/0.log" Jun 11 15:44:09.072482 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:09.072400 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5978c9768d-x8ts5_e914988a-b45b-4756-ae7b-503e160c41fc/manager/0.log" Jun 11 15:44:09.419847 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:09.419792 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f75ddbfd7-lvx9f_2d79e32b-af07-42b1-b2be-15f5732eec1b/manager/0.log" Jun 11 15:44:09.459539 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:09.459514 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f75ddbfd7-lvx9f_2d79e32b-af07-42b1-b2be-15f5732eec1b/copy-manifests/0.log" Jun 11 15:44:11.252512 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:11.252469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-87f58c8fb-6zj2z_0cc669df-097c-46ca-804a-f2ca0c0cdbaa/manager/0.log" Jun 11 15:44:11.316354 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:11.316329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-stpzd_0501aeec-745a-4641-892b-9e37d864388f/openshift-lws-operator/0.log" Jun 11 15:44:14.247262 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:14.247235 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-677b9b985557n4s_f13ad83a-8355-4f9a-b5e3-ae9c4c13162c/istio-proxy/0.log" Jun 11 15:44:14.374520 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:14.374488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7c4d88f86d-697nx_6d0a5ce7-0dd4-4cc4-987c-27688381f981/istio-proxy/0.log" Jun 11 15:44:14.404175 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:14.404140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7c4d88f86d-697nx_6d0a5ce7-0dd4-4cc4-987c-27688381f981/istio-proxy/1.log" Jun 11 15:44:14.425840 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:14.425795 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gqk6h_9e916930-703d-49e8-a96f-ed214d3fcba2/payload-pre-processing/0.log" Jun 11 15:44:14.476191 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:14.476167 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-l7sml_41e93811-b6e2-40c0-87a7-68bf18e4618d/payload-processing/0.log" Jun 11 15:44:15.726301 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:15.726273 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-677b9b985557n4s_f13ad83a-8355-4f9a-b5e3-ae9c4c13162c/istio-proxy/0.log" Jun 11 15:44:15.893204 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:15.893173 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7c4d88f86d-697nx_6d0a5ce7-0dd4-4cc4-987c-27688381f981/istio-proxy/0.log" Jun 11 15:44:15.925719 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:15.925686 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7c4d88f86d-697nx_6d0a5ce7-0dd4-4cc4-987c-27688381f981/istio-proxy/1.log" Jun 11 15:44:15.946767 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:15.946737 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gqk6h_9e916930-703d-49e8-a96f-ed214d3fcba2/payload-pre-processing/0.log" Jun 11 15:44:16.001279 ip-10-0-136-38 kubenswrapper[2576]: I0611 15:44:16.001188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-l7sml_41e93811-b6e2-40c0-87a7-68bf18e4618d/payload-processing/0.log"