Jun 15 04:22:56.890488 ip-10-0-136-236 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 04:22:56.890495 ip-10-0-136-236 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 04:22:56.890506 ip-10-0-136-236 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 04:22:56.890841 ip-10-0-136-236 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 04:23:08.141777 ip-10-0-136-236 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 04:23:08.141799 ip-10-0-136-236 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 585e6e65f8614d50bb57a7f886cecd93 -- Jun 15 04:25:27.329008 ip-10-0-136-236 systemd[1]: Starting Kubernetes Kubelet... Jun 15 04:25:27.679192 ip-10-0-136-236 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 04:25:27.679192 ip-10-0-136-236 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 04:25:27.679192 ip-10-0-136-236 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 04:25:27.679192 ip-10-0-136-236 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 04:25:27.679192 ip-10-0-136-236 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 04:25:27.680010 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.679861 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 04:25:27.685061 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685034 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:27.685061 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685055 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:27.685061 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685060 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:27.685061 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685064 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:27.685061 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685067 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:27.685061 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685070 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685073 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685076 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685079 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685084 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685089 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685092 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685096 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685099 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685103 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685105 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685108 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685111 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685114 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685117 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685120 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685123 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685126 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:27.685307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685128 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685133 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685136 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685140 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685143 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685146 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685149 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685152 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685155 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685158 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685160 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685163 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685165 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685168 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685170 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685173 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685178 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685181 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685184 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685186 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:27.685772 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685189 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685191 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685194 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685196 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685199 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685202 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685204 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685207 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685210 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685213 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685216 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685218 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685221 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685224 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685228 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685231 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685234 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685236 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685239 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:27.686252 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685241 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685244 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685246 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685249 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685252 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685254 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685257 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685260 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685263 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685266 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685296 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685300 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685303 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685306 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685309 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685313 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685316 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685319 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685322 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685325 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:27.686731 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685328 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685331 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685334 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685336 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685339 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685341 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685344 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685348 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685351 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685354 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685357 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685359 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685362 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685365 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685368 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685370 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.685373 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686237 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686244 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686247 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:27.687212 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686250 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686254 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686257 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686260 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686263 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686266 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686269 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686271 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686274 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686277 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686279 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686282 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686285 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686288 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686291 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686294 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686296 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686299 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686302 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686305 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:27.687738 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686307 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686310 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686313 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686315 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686318 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686320 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686323 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686325 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686328 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686330 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686333 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686335 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686338 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686341 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686344 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686347 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686349 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686352 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686354 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686357 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:27.688225 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686359 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686362 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686364 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686368 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686370 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686373 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686375 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686379 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686382 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686385 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686388 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686390 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686393 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686395 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686398 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686401 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686403 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686406 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686408 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686410 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:27.688770 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686413 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686415 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686418 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686423 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686426 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686430 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686433 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686436 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686438 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686441 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686444 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686447 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686449 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686452 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686454 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686457 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686459 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686470 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686474 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:27.689264 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686477 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686481 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686485 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686489 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686492 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686495 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686498 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686500 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686503 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686506 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686508 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686510 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686513 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686515 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686518 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686521 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686523 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686973 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686980 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:27.689756 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686984 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686987 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686990 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686993 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686996 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.686998 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687001 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687004 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687006 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687009 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687012 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687015 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687017 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687020 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687023 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687025 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687029 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687032 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687034 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687037 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:27.690259 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687039 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687042 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687044 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687047 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687049 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687052 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687054 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687057 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687059 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687062 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687064 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687067 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687070 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687073 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687075 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687078 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687080 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687083 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687086 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687088 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:27.690755 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687091 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687094 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687096 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687099 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687101 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687104 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687106 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687109 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687112 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687115 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687117 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687120 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687122 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687125 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687127 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687130 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687139 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687142 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687145 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:27.691250 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687148 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687151 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687153 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687156 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687160 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687162 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687165 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687168 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687171 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687173 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687176 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687179 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687181 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687184 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687186 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687189 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687192 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687197 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687200 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687203 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:27.691742 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687209 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687214 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687217 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687220 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687222 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687225 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687228 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687230 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687234 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687238 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687241 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687244 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687247 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687250 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687253 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687256 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687258 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687261 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687343 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687351 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 04:25:27.692236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687358 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687363 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687370 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687373 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687377 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687382 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687385 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687388 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687391 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687394 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687398 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687401 2554 flags.go:64] FLAG: --cgroup-root="" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687406 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687409 2554 flags.go:64] FLAG: --client-ca-file="" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687413 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687417 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687422 2554 flags.go:64] FLAG: --cluster-domain="" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687425 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687428 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687431 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687434 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687438 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687441 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 04:25:27.692737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687444 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687448 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687451 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687454 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687457 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687460 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687463 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687467 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687470 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687473 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687476 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687479 2554 flags.go:64] FLAG: --enable-server="true" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687482 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687486 2554 flags.go:64] FLAG: --event-burst="100" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687489 2554 flags.go:64] FLAG: --event-qps="50" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687492 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687495 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687498 2554 flags.go:64] FLAG: --eviction-hard="" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687502 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687505 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687508 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687512 2554 flags.go:64] FLAG: --eviction-soft="" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687515 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687518 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687522 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 04:25:27.693294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687525 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687528 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687531 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687534 2554 flags.go:64] FLAG: --feature-gates="" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687537 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687541 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687544 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687547 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687550 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687553 2554 flags.go:64] FLAG: --help="false" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687555 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687559 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687562 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687564 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687568 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687571 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687574 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687577 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687580 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687583 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687586 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687589 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687592 2554 flags.go:64] FLAG: --kube-reserved="" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687594 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 04:25:27.693934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687597 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687600 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687603 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687606 2554 flags.go:64] FLAG: --lock-file="" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687610 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687613 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687616 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687622 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687625 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687628 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687631 2554 flags.go:64] FLAG: --logging-format="text" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687634 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687637 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687640 2554 flags.go:64] FLAG: --manifest-url="" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687643 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687648 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687650 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687655 2554 flags.go:64] FLAG: --max-pods="110" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687657 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687660 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687663 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687666 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687669 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687691 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687695 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 04:25:27.694530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687703 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687706 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687709 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687712 2554 flags.go:64] FLAG: --pod-cidr="" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687715 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687721 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687724 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687727 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687730 2554 flags.go:64] FLAG: --port="10250" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687733 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687735 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04657aed2c9d6234d" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687738 2554 flags.go:64] FLAG: --qos-reserved="" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687743 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687746 2554 flags.go:64] FLAG: --register-node="true" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687750 2554 flags.go:64] FLAG: --register-with-taints="" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687754 2554 flags.go:64] FLAG: --registry-burst="10" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687758 2554 flags.go:64] FLAG: --registry-qps="5" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687761 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687764 2554 flags.go:64] FLAG: --reserved-memory="" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687768 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687772 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687775 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687778 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687781 2554 flags.go:64] FLAG: --runonce="false" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687784 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 04:25:27.695166 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687787 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687790 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687793 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687796 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687799 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687802 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687805 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687808 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687811 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687814 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687816 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687819 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687822 2554 flags.go:64] FLAG: --system-cgroups="" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687825 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687830 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687833 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687836 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687840 2554 flags.go:64] FLAG: --tls-min-version="" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687843 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687847 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687850 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687853 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687856 2554 flags.go:64] FLAG: --v="2" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687860 2554 flags.go:64] FLAG: --version="false" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687865 2554 flags.go:64] FLAG: --vmodule="" Jun 15 04:25:27.695781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687869 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.687872 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687991 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687995 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.687998 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688001 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688004 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688007 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688009 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688014 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688018 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688021 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688023 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688026 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688029 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688032 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688035 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688038 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688041 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688043 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:27.696393 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688046 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688048 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688051 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688054 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688056 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688058 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688062 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688065 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688068 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688070 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688073 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688075 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688078 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688081 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688089 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688091 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688094 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688097 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688100 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688102 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:27.696918 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688105 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688108 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688110 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688113 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688115 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688118 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688120 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688123 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688125 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688128 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688132 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688135 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688138 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688141 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688144 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688147 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688150 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688153 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688157 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:27.697470 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688159 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688162 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688164 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688167 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688170 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688172 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688176 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688182 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688184 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688187 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688190 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688192 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688195 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688198 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688200 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688203 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688205 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688208 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688211 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:27.697967 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688213 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688215 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688218 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688221 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688223 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688226 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688229 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688231 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688235 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688238 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688241 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688243 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688248 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688250 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688253 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688256 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688259 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688261 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688264 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688266 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:27.698432 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688270 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688273 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.688275 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.688841 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.695546 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.695565 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.695578 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.695585 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695641 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695646 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695650 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695653 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695656 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695660 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695663 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:27.698974 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695666 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695669 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695688 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695692 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695695 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695698 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695700 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695704 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695708 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695712 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695715 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695718 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695721 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695723 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695726 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695728 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695731 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695735 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695737 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:27.699437 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695740 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695742 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695745 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695748 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695751 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695754 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695756 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695759 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695762 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695764 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695767 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695770 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695772 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695775 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695777 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695780 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695783 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695786 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695789 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695791 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:27.699928 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695794 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695797 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695800 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695804 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695807 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695810 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695813 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695817 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695820 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695823 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695826 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695830 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695832 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695835 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695838 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695842 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695845 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695847 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695850 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:27.700424 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695853 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695855 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695858 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695860 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695863 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695866 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695868 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695871 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695873 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695876 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695878 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695881 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695885 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695888 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695891 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695894 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695896 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695899 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695902 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:27.700923 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695904 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695907 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695910 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695912 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695915 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695918 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695921 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695924 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695927 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695930 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695932 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695935 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695938 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695940 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.695943 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:27.701394 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.695948 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696066 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696071 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696074 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696077 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696080 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696083 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696085 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696088 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696092 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696094 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696098 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696102 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696105 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696109 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696112 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696115 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696118 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696121 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:27.701904 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696124 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696127 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696129 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696132 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696135 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696138 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696141 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696144 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696147 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696149 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696152 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696154 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696157 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696159 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696162 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696165 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696167 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696170 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696172 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696175 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:27.702403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696178 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696180 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696183 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696185 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696188 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696190 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696193 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696195 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696198 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696201 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696204 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696206 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696209 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696212 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696214 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696216 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696219 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696221 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696224 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696227 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:27.702913 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696230 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696232 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696235 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696237 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696240 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696242 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696245 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696247 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696250 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696252 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696255 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696266 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696269 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696272 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696275 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696279 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696282 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696285 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696289 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:27.703403 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696292 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696295 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696298 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696301 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696303 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696306 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696308 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696311 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696314 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696317 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696319 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696322 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696325 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696328 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696330 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696333 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696335 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696338 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696341 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696343 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:27.703896 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696346 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:27.696348 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.696353 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.696477 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.698769 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.700085 2554 server.go:1019] "Starting client certificate rotation" Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.700188 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.700252 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 04:25:27.704382 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.702375 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 04:25:27.706096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.706076 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 04:25:27.714384 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.714361 2554 log.go:25] "Validated CRI v1 runtime API" Jun 15 04:25:27.717771 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.717754 2554 log.go:25] "Validated CRI v1 image API" Jun 15 04:25:27.719098 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.719076 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 04:25:27.721912 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.721877 2554 fs.go:135] Filesystem UUIDs: map[563cb446-dd46-4ad1-a96e-dce135ffb2b1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 88a09e75-92ec-49ea-ba23-51f21fcf24bb:/dev/nvme0n1p4] Jun 15 04:25:27.722010 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.721910 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 04:25:27.727753 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.727607 2554 manager.go:216] Machine: {Timestamp:2026-06-15 04:25:27.725685256 +0000 UTC m=+0.288980215 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106159 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec76535b8d26718cf9eaae8bc8cf4 SystemUUID:ec2ec765-35b8-d267-18cf-9eaae8bc8cf4 BootID:585e6e65-f861-4d50-bb57-a7f886cecd93 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:c1:51:8b:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:c1:51:8b:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:e3:f2:12:89:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 04:25:27.727753 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.727745 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 04:25:27.727928 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.727845 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 04:25:27.727928 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.727866 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 04:25:27.730570 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.730543 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 04:25:27.730730 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.730575 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 04:25:27.731370 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.731360 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 04:25:27.731404 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.731372 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 04:25:27.731404 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.731380 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 04:25:27.731992 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.731981 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 04:25:27.733538 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.733528 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 04:25:27.736331 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736319 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 15 04:25:27.736467 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736457 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 04:25:27.736506 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736489 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 15 04:25:27.736506 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736499 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 04:25:27.736573 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736511 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 04:25:27.736573 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736521 2554 kubelet.go:398] "Adding apiserver pod source" Jun 15 04:25:27.736573 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736530 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 04:25:27.737000 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.736984 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 04:25:27.737065 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.737009 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 04:25:27.739185 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.739166 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 04:25:27.740837 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.740823 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 04:25:27.740911 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.740853 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 04:25:27.741041 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741031 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 04:25:27.741078 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741046 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 04:25:27.741078 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741054 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 04:25:27.741078 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741063 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 04:25:27.741078 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741075 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 04:25:27.741185 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741083 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 04:25:27.741538 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741528 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 04:25:27.741538 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741538 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 04:25:27.741609 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741545 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 04:25:27.741609 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741550 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 04:25:27.741609 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741564 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 04:25:27.741609 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.741572 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 04:25:27.742115 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.742098 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hsplj" Jun 15 04:25:27.742228 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.742219 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 04:25:27.742258 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.742230 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 04:25:27.744310 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.744280 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 04:25:27.744398 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.744289 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 04:25:27.744398 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.744342 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 04:25:27.745740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.745726 2554 server.go:1268] "Started kubelet" Jun 15 04:25:27.745857 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.745827 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 04:25:27.745857 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.745844 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 04:25:27.745980 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.745877 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 04:25:27.746523 ip-10-0-136-236 systemd[1]: Started Kubernetes Kubelet. Jun 15 04:25:27.749846 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.749820 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 04:25:27.750522 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.750498 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hsplj" Jun 15 04:25:27.751591 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.751571 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 15 04:25:27.752524 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.752495 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 04:25:27.753723 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.752898 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-236.ec2.internal.18b926900d84f7b7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-236.ec2.internal,UID:ip-10-0-136-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-236.ec2.internal,},FirstTimestamp:2026-06-15 04:25:27.745705911 +0000 UTC m=+0.309000826,LastTimestamp:2026-06-15 04:25:27.745705911 +0000 UTC m=+0.309000826,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-236.ec2.internal,}" Jun 15 04:25:27.757128 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.757030 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 04:25:27.757128 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.757038 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 04:25:27.757233 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.757202 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:27.759300 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.757765 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 04:25:27.759300 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.757800 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 04:25:27.759300 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.757813 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 04:25:27.759830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.759355 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 15 04:25:27.759830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.759370 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 15 04:25:27.760785 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.760762 2554 factory.go:55] Registering systemd factory Jun 15 04:25:27.760785 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.760786 2554 factory.go:223] Registration of the systemd container factory successfully Jun 15 04:25:27.761037 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.761024 2554 factory.go:153] Registering CRI-O factory Jun 15 04:25:27.761037 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.761037 2554 factory.go:223] Registration of the crio container factory successfully Jun 15 04:25:27.761181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.761096 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 04:25:27.761181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.761120 2554 factory.go:103] Registering Raw factory Jun 15 04:25:27.761181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.761132 2554 manager.go:1196] Started watching for new ooms in manager Jun 15 04:25:27.762035 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.762019 2554 manager.go:349] Starting recovery of all containers Jun 15 04:25:27.765645 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.765622 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:27.767946 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.767660 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-236.ec2.internal\" not found" node="ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.771337 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.771321 2554 manager.go:354] Recovery completed Jun 15 04:25:27.775757 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.775744 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:27.777662 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.777647 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:27.777736 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.777689 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:27.777736 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.777703 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:27.778297 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.778276 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 04:25:27.778297 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.778289 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 04:25:27.778408 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.778308 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 15 04:25:27.778408 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.778292 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:27.779216 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.779202 2554 policy_none.go:49] "None policy: Start" Jun 15 04:25:27.779216 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.779219 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 04:25:27.779309 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.779229 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 04:25:27.780012 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.780001 2554 policy_none.go:47] "Start" Jun 15 04:25:27.780535 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.780514 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:27.780618 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.780550 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:27.780618 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.780563 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:27.813329 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.813309 2554 manager.go:337] "Starting Device Plugin manager" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.813360 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.813374 2554 server.go:87] "Starting device plugin registration server" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.813723 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.813735 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.813843 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.813922 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.813931 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.814624 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.814667 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.821393 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.822616 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.822649 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.822668 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.822734 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 04:25:27.824557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.824240 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:27.913865 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.913813 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:27.914948 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.914933 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:27.915024 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.914966 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:27.915024 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.914982 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:27.915024 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.915013 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.921979 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.921963 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.922031 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.921987 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-236.ec2.internal\": node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:27.922791 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.922776 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal"] Jun 15 04:25:27.922842 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.922834 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:27.923744 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.923726 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:27.923844 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.923764 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:27.923844 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.923779 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:27.925016 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.924998 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:27.925130 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925116 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.925170 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925152 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:27.925854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925839 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:27.925933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925871 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:27.925933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925882 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:27.925994 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925839 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:27.925994 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925960 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:27.925994 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.925975 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:27.927079 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.927065 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.927128 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.927089 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:27.927772 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.927754 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:27.927843 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.927790 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:27.927843 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.927807 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:27.935973 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.935957 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:27.948312 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.948290 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-236.ec2.internal\" not found" node="ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.952841 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:27.952827 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-236.ec2.internal\" not found" node="ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.960111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.960096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c413027eb0bb170f8771430424e22e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal\" (UID: \"8c413027eb0bb170f8771430424e22e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.960169 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.960118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c413027eb0bb170f8771430424e22e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal\" (UID: \"8c413027eb0bb170f8771430424e22e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:27.960169 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:27.960136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bab8913c76df9e2a70aeb901b774a32-config\") pod \"kube-apiserver-proxy-ip-10-0-136-236.ec2.internal\" (UID: \"9bab8913c76df9e2a70aeb901b774a32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.036688 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.036647 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.060840 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.060816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c413027eb0bb170f8771430424e22e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal\" (UID: \"8c413027eb0bb170f8771430424e22e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.060915 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.060846 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c413027eb0bb170f8771430424e22e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal\" (UID: \"8c413027eb0bb170f8771430424e22e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.060915 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.060863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bab8913c76df9e2a70aeb901b774a32-config\") pod \"kube-apiserver-proxy-ip-10-0-136-236.ec2.internal\" (UID: \"9bab8913c76df9e2a70aeb901b774a32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.060915 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.060913 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bab8913c76df9e2a70aeb901b774a32-config\") pod \"kube-apiserver-proxy-ip-10-0-136-236.ec2.internal\" (UID: \"9bab8913c76df9e2a70aeb901b774a32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.061022 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.060914 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c413027eb0bb170f8771430424e22e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal\" (UID: \"8c413027eb0bb170f8771430424e22e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.061022 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.060934 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c413027eb0bb170f8771430424e22e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal\" (UID: \"8c413027eb0bb170f8771430424e22e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.137279 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.137232 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.237947 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.237860 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.252053 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.252023 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.256999 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.256981 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.338353 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.338309 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.438868 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.438833 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.539354 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.539328 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.639883 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.639845 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.699402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.699362 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 04:25:28.699960 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.699534 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 04:25:28.699960 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.699561 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 04:25:28.740807 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.740770 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.752905 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.752875 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 04:20:27 +0000 UTC" deadline="2028-03-26 09:57:29.852150974 +0000 UTC" Jun 15 04:25:28.752905 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.752903 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15605h32m1.099250559s" Jun 15 04:25:28.841013 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:28.840973 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-236.ec2.internal\" not found" Jun 15 04:25:28.843425 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:28.843392 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c413027eb0bb170f8771430424e22e4.slice/crio-886c5c24e71f5f28bab90f28b73cfadd2592caaddc434d7ccabcbea060f646c3 WatchSource:0}: Error finding container 886c5c24e71f5f28bab90f28b73cfadd2592caaddc434d7ccabcbea060f646c3: Status 404 returned error can't find the container with id 886c5c24e71f5f28bab90f28b73cfadd2592caaddc434d7ccabcbea060f646c3 Jun 15 04:25:28.844709 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:28.844684 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bab8913c76df9e2a70aeb901b774a32.slice/crio-d7b155c75885d9c6f379aa654bbf62b771bb64204ab4be624f7afc390c724030 WatchSource:0}: Error finding container d7b155c75885d9c6f379aa654bbf62b771bb64204ab4be624f7afc390c724030: Status 404 returned error can't find the container with id d7b155c75885d9c6f379aa654bbf62b771bb64204ab4be624f7afc390c724030 Jun 15 04:25:28.847929 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.847910 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:25:28.901007 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.900973 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:28.958128 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.958094 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.968893 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.968863 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 04:25:28.970644 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.970626 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" Jun 15 04:25:28.978437 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:28.978419 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 04:25:29.322373 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.322338 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:29.738227 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.738150 2554 apiserver.go:52] "Watching apiserver" Jun 15 04:25:29.744074 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.744049 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:29.745017 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.744994 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 04:25:29.746123 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.746095 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-sz2kd","openshift-multus/network-metrics-daemon-tqgb2","openshift-network-diagnostics/network-check-target-4tght","kube-system/konnectivity-agent-wdmg5","kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp","openshift-dns/node-resolver-g78tp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal","openshift-multus/multus-9nndf","openshift-network-operator/iptables-alerter-lptz9","openshift-ovn-kubernetes/ovnkube-node-g9xbf","kube-system/global-pull-secret-syncer-lwphn","openshift-cluster-node-tuning-operator/tuned-kv7df","openshift-image-registry/node-ca-gm67b"] Jun 15 04:25:29.747731 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.747702 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.749963 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.749939 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.750481 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.750463 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 04:25:29.750572 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.750463 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:25:29.750636 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.750564 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5q4x9\"" Jun 15 04:25:29.750636 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.750466 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 04:25:29.751362 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.751345 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.752108 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.752081 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 04:25:29.752209 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.752160 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 04:25:29.752480 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.752458 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.753165 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753019 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 04:25:29.753165 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753071 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jbxbj\"" Jun 15 04:25:29.753165 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753106 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 04:25:29.753349 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753190 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 04:25:29.753349 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753267 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 04:25:29.753536 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753519 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 04:25:29.753599 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753523 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s2w6c\"" Jun 15 04:25:29.753793 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.753777 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 04:25:29.754943 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.754893 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 04:25:29.754943 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.754911 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 04:25:29.755136 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.755117 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 04:25:29.755294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.755276 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 04:25:29.755389 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.755356 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xfr75\"" Jun 15 04:25:29.755493 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.755476 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 04:25:29.756175 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.755389 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:29.756175 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.755962 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:29.756329 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.756210 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.757377 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.757331 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.757852 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.757833 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 04:25:29.758576 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.758378 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 04:25:29.758576 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.758421 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 04:25:29.758576 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.758480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kpwvd\"" Jun 15 04:25:29.758849 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.758690 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.758849 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.758694 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 04:25:29.759499 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.759482 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 04:25:29.759643 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.759627 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lgsvr\"" Jun 15 04:25:29.759735 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.759702 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:29.760848 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.760827 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 04:25:29.760943 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.760866 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8wmnt\"" Jun 15 04:25:29.760943 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.760873 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:25:29.761095 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.761076 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:29.761209 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.761141 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:29.761892 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.761870 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mz9pd\"" Jun 15 04:25:29.762030 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.761898 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 04:25:29.762030 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.761939 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 04:25:29.762301 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.762279 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.762388 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.762346 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:29.763325 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.763309 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.766356 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.766337 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 04:25:29.766445 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.766414 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 04:25:29.766445 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.766422 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 04:25:29.766568 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.766553 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dltqv\"" Jun 15 04:25:29.770419 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.770401 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 04:25:29.771555 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771534 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-system-cni-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.771640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-multus-certs\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.771640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771584 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysconfig\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.771640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771620 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-modprobe-d\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.771805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771644 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-var-lib-kubelet\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.771805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771666 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8646a2-3ef1-4b10-b0a4-2d3285297793-tmp-dir\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.771805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771713 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-registration-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.771805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771737 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-slash\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.771805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771757 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-run-netns\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.771805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-etc-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.771805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-cni-bin\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771825 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a75ecff6-e96d-4a43-afe1-1c288fd1da65-iptables-alerter-script\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771850 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-os-release\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-systemd-units\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771899 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-cnibin\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-cni-multus\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-lib-modules\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.771990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-node-log\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772016 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-env-overrides\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772066 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-socket-dir-parent\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772095 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysctl-conf\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772137 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-run\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.772153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772158 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772173 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-cni-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772208 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b71cf357-e4e1-4c59-924b-056e945e7e55-tmp\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovnkube-script-lib\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-system-cni-dir\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-cnibin\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-sys\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-cni-netd\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772492 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-systemd\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrww\" (UniqueName: \"kubernetes.io/projected/b71cf357-e4e1-4c59-924b-056e945e7e55-kube-api-access-khrww\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-socket-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4dbl\" (UniqueName: \"kubernetes.io/projected/a75ecff6-e96d-4a43-afe1-1c288fd1da65-kube-api-access-x4dbl\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772651 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.772693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772697 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a165f07-7919-4ca4-aa9d-a1e5860a013b-cni-binary-copy\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-daemon-config\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-kubernetes\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772794 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znfdp\" (UniqueName: \"kubernetes.io/projected/7b8646a2-3ef1-4b10-b0a4-2d3285297793-kube-api-access-znfdp\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-cni-binary-copy\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772864 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-netns\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-host\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772955 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b8646a2-3ef1-4b10-b0a4-2d3285297793-hosts-file\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.772989 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-var-lib-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-log-socket\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-k8s-cni-cncf-io\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773117 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq948\" (UniqueName: \"kubernetes.io/projected/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-kube-api-access-wq948\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-etc-selinux\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773196 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.773281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773222 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-conf-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-systemd\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2684g\" (UniqueName: \"kubernetes.io/projected/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-kube-api-access-2684g\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-kubelet\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-tuned\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-device-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5qgw\" (UniqueName: \"kubernetes.io/projected/7df04f43-9cec-42cc-9567-1a9a0a36a049-kube-api-access-t5qgw\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysctl-d\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-sys-fs\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773413 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a75ecff6-e96d-4a43-afe1-1c288fd1da65-host-slash\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-ovn\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773489 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovnkube-config\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovn-node-metrics-cert\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773537 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrvq\" (UniqueName: \"kubernetes.io/projected/c1676af7-bcc1-4427-b25a-fca61b088bca-kube-api-access-bxrvq\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-os-release\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.774034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773597 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-hostroot\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.774896 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773639 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-kubelet\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774896 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773668 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-cni-bin\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.774896 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773717 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7bh\" (UniqueName: \"kubernetes.io/projected/6a165f07-7919-4ca4-aa9d-a1e5860a013b-kube-api-access-pr7bh\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.774896 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.773752 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-etc-kubernetes\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.787123 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.787101 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xg5rc" Jun 15 04:25:29.793706 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.793667 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xg5rc" Jun 15 04:25:29.826746 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.826690 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" event={"ID":"8c413027eb0bb170f8771430424e22e4","Type":"ContainerStarted","Data":"886c5c24e71f5f28bab90f28b73cfadd2592caaddc434d7ccabcbea060f646c3"} Jun 15 04:25:29.827861 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.827838 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" event={"ID":"9bab8913c76df9e2a70aeb901b774a32","Type":"ContainerStarted","Data":"d7b155c75885d9c6f379aa654bbf62b771bb64204ab4be624f7afc390c724030"} Jun 15 04:25:29.859110 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.859082 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 04:25:29.874495 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874456 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-systemd\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2684g\" (UniqueName: \"kubernetes.io/projected/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-kube-api-access-2684g\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-kubelet\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-tuned\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874563 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-systemd\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-device-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874622 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-kubelet\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874641 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-device-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.874690 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5qgw\" (UniqueName: \"kubernetes.io/projected/7df04f43-9cec-42cc-9567-1a9a0a36a049-kube-api-access-t5qgw\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysctl-d\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-sys-fs\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874772 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a16488f-7114-48dd-9354-5b4e5b1cf71e-host\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874796 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a75ecff6-e96d-4a43-afe1-1c288fd1da65-host-slash\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874838 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-sys-fs\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874886 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-ovn\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874845 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-ovn\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874902 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a75ecff6-e96d-4a43-afe1-1c288fd1da65-host-slash\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874926 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovnkube-config\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874943 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-run-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874956 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovn-node-metrics-cert\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874972 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysctl-d\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874981 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 04:25:29.875096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.874982 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrvq\" (UniqueName: \"kubernetes.io/projected/c1676af7-bcc1-4427-b25a-fca61b088bca-kube-api-access-bxrvq\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-os-release\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-hostroot\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-kubelet\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875206 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-cni-bin\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7bh\" (UniqueName: \"kubernetes.io/projected/6a165f07-7919-4ca4-aa9d-a1e5860a013b-kube-api-access-pr7bh\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-etc-kubernetes\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875267 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-system-cni-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875306 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-multus-certs\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875331 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysconfig\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875350 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-os-release\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-modprobe-d\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-var-lib-kubelet\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8646a2-3ef1-4b10-b0a4-2d3285297793-tmp-dir\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875464 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-registration-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875472 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-modprobe-d\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-slash\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.875817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-run-netns\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875539 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovnkube-config\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-etc-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-cni-bin\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aaa4f0d7-fd67-4607-bd66-83f8a56e7ead-konnectivity-ca\") pod \"konnectivity-agent-wdmg5\" (UID: \"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead\") " pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a75ecff6-e96d-4a43-afe1-1c288fd1da65-iptables-alerter-script\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-os-release\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875718 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-etc-kubernetes\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/86e420ba-4a99-443e-92e3-86d4d76be538-dbus\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875755 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-systemd-units\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-cnibin\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875789 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-registration-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-cni-multus\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875819 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-kubelet\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-lib-modules\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875831 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8646a2-3ef1-4b10-b0a4-2d3285297793-tmp-dir\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.876727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a16488f-7114-48dd-9354-5b4e5b1cf71e-serviceca\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-etc-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875833 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-slash\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875881 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-var-lib-kubelet\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875915 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-run-netns\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875943 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-system-cni-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875930 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-cni-bin\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875969 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-cni-bin\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.875995 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-var-lib-cni-multus\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-node-log\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876049 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-lib-modules\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-env-overrides\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876089 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-node-log\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876081 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-os-release\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876134 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-multus-certs\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876252 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-systemd-units\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876367 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-hostroot\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876422 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-cnibin\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.877558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-socket-dir-parent\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876478 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysctl-conf\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876502 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-run\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876525 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-cni-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b71cf357-e4e1-4c59-924b-056e945e7e55-tmp\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876603 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/86e420ba-4a99-443e-92e3-86d4d76be538-kubelet-config\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovnkube-script-lib\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-system-cni-dir\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-cnibin\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-sys\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876762 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-socket-dir-parent\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-cni-netd\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876808 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysconfig\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876808 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-systemd\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.879270 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876867 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrww\" (UniqueName: \"kubernetes.io/projected/b71cf357-e4e1-4c59-924b-056e945e7e55-kube-api-access-khrww\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-socket-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aaa4f0d7-fd67-4607-bd66-83f8a56e7ead-agent-certs\") pod \"konnectivity-agent-wdmg5\" (UID: \"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead\") " pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876935 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876947 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4dbl\" (UniqueName: \"kubernetes.io/projected/a75ecff6-e96d-4a43-afe1-1c288fd1da65-kube-api-access-x4dbl\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876973 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876980 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-system-cni-dir\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876996 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a165f07-7919-4ca4-aa9d-a1e5860a013b-cni-binary-copy\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877021 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-daemon-config\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877026 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1676af7-bcc1-4427-b25a-fca61b088bca-cnibin\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876704 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a75ecff6-e96d-4a43-afe1-1c288fd1da65-iptables-alerter-script\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-kubernetes\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znfdp\" (UniqueName: \"kubernetes.io/projected/7b8646a2-3ef1-4b10-b0a4-2d3285297793-kube-api-access-znfdp\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877088 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-cni-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-cni-binary-copy\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.876631 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-env-overrides\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-netns\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.880120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877149 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-host\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877173 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b8646a2-3ef1-4b10-b0a4-2d3285297793-hosts-file\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877197 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-var-lib-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-log-socket\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877262 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-sysctl-conf\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877278 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-k8s-cni-cncf-io\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877306 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq948\" (UniqueName: \"kubernetes.io/projected/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-kube-api-access-wq948\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877316 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-run\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-etc-selinux\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877360 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877410 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-systemd\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877604 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877629 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-run-ovn-kubernetes\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877647 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-socket-dir\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877649 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovnkube-script-lib\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrzc8\" (UniqueName: \"kubernetes.io/projected/4a16488f-7114-48dd-9354-5b4e5b1cf71e-kube-api-access-hrzc8\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.880927 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877692 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-cni-netd\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877732 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877773 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b8646a2-3ef1-4b10-b0a4-2d3285297793-hosts-file\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877786 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-conf-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877856 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-conf-dir\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877894 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877979 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-log-socket\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.877997 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-sys\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878042 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-var-lib-openvswitch\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.878090 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.878157 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:25:30.378136705 +0000 UTC m=+2.941431622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878204 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-k8s-cni-cncf-io\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878290 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a165f07-7919-4ca4-aa9d-a1e5860a013b-multus-daemon-config\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878345 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a165f07-7919-4ca4-aa9d-a1e5860a013b-host-run-netns\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878396 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-host\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878424 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.881462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878452 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7df04f43-9cec-42cc-9567-1a9a0a36a049-etc-selinux\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.882196 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878501 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1676af7-bcc1-4427-b25a-fca61b088bca-cni-binary-copy\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.882196 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878512 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-kubernetes\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.882196 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878731 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b71cf357-e4e1-4c59-924b-056e945e7e55-etc-tuned\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.882196 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.878836 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a165f07-7919-4ca4-aa9d-a1e5860a013b-cni-binary-copy\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.882196 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.879889 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-ovn-node-metrics-cert\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.882196 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.880038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b71cf357-e4e1-4c59-924b-056e945e7e55-tmp\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.885626 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.885598 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5qgw\" (UniqueName: \"kubernetes.io/projected/7df04f43-9cec-42cc-9567-1a9a0a36a049-kube-api-access-t5qgw\") pod \"aws-ebs-csi-driver-node-2d2kp\" (UID: \"7df04f43-9cec-42cc-9567-1a9a0a36a049\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:29.886054 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.886027 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7bh\" (UniqueName: \"kubernetes.io/projected/6a165f07-7919-4ca4-aa9d-a1e5860a013b-kube-api-access-pr7bh\") pod \"multus-9nndf\" (UID: \"6a165f07-7919-4ca4-aa9d-a1e5860a013b\") " pod="openshift-multus/multus-9nndf" Jun 15 04:25:29.887913 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.887886 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrvq\" (UniqueName: \"kubernetes.io/projected/c1676af7-bcc1-4427-b25a-fca61b088bca-kube-api-access-bxrvq\") pod \"multus-additional-cni-plugins-sz2kd\" (UID: \"c1676af7-bcc1-4427-b25a-fca61b088bca\") " pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:29.888480 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.888439 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znfdp\" (UniqueName: \"kubernetes.io/projected/7b8646a2-3ef1-4b10-b0a4-2d3285297793-kube-api-access-znfdp\") pod \"node-resolver-g78tp\" (UID: \"7b8646a2-3ef1-4b10-b0a4-2d3285297793\") " pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:29.888563 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.888483 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2684g\" (UniqueName: \"kubernetes.io/projected/b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9-kube-api-access-2684g\") pod \"ovnkube-node-g9xbf\" (UID: \"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:29.888904 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.888881 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrww\" (UniqueName: \"kubernetes.io/projected/b71cf357-e4e1-4c59-924b-056e945e7e55-kube-api-access-khrww\") pod \"tuned-kv7df\" (UID: \"b71cf357-e4e1-4c59-924b-056e945e7e55\") " pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:29.889002 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.888911 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4dbl\" (UniqueName: \"kubernetes.io/projected/a75ecff6-e96d-4a43-afe1-1c288fd1da65-kube-api-access-x4dbl\") pod \"iptables-alerter-lptz9\" (UID: \"a75ecff6-e96d-4a43-afe1-1c288fd1da65\") " pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:29.889241 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.889211 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq948\" (UniqueName: \"kubernetes.io/projected/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-kube-api-access-wq948\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:29.979077 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aaa4f0d7-fd67-4607-bd66-83f8a56e7ead-agent-certs\") pod \"konnectivity-agent-wdmg5\" (UID: \"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead\") " pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:29.979263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrzc8\" (UniqueName: \"kubernetes.io/projected/4a16488f-7114-48dd-9354-5b4e5b1cf71e-kube-api-access-hrzc8\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.979263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979142 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a16488f-7114-48dd-9354-5b4e5b1cf71e-host\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.979263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979178 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:29.979263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aaa4f0d7-fd67-4607-bd66-83f8a56e7ead-konnectivity-ca\") pod \"konnectivity-agent-wdmg5\" (UID: \"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead\") " pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:29.979263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979235 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.979263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979251 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a16488f-7114-48dd-9354-5b4e5b1cf71e-host\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.979544 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/86e420ba-4a99-443e-92e3-86d4d76be538-dbus\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.979544 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a16488f-7114-48dd-9354-5b4e5b1cf71e-serviceca\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.979544 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979351 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/86e420ba-4a99-443e-92e3-86d4d76be538-kubelet-config\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.979544 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979404 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/86e420ba-4a99-443e-92e3-86d4d76be538-dbus\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.979544 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979425 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/86e420ba-4a99-443e-92e3-86d4d76be538-kubelet-config\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:29.979544 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.979468 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:29.979822 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.979557 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret podName:86e420ba-4a99-443e-92e3-86d4d76be538 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:30.479536141 +0000 UTC m=+3.042831043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret") pod "global-pull-secret-syncer-lwphn" (UID: "86e420ba-4a99-443e-92e3-86d4d76be538") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:29.979880 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979846 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aaa4f0d7-fd67-4607-bd66-83f8a56e7ead-konnectivity-ca\") pod \"konnectivity-agent-wdmg5\" (UID: \"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead\") " pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:29.979880 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.979866 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a16488f-7114-48dd-9354-5b4e5b1cf71e-serviceca\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:29.981899 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.981879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aaa4f0d7-fd67-4607-bd66-83f8a56e7ead-agent-certs\") pod \"konnectivity-agent-wdmg5\" (UID: \"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead\") " pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:29.987255 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.987234 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:29.987255 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.987258 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:29.987426 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.987274 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fvbnp for pod openshift-network-diagnostics/network-check-target-4tght: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:29.987426 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:29.987354 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp podName:fca12851-aa26-45b5-ae7f-ddb4318e5fcb nodeName:}" failed. No retries permitted until 2026-06-15 04:25:30.487337657 +0000 UTC m=+3.050632562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fvbnp" (UniqueName: "kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp") pod "network-check-target-4tght" (UID: "fca12851-aa26-45b5-ae7f-ddb4318e5fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:29.989520 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:29.989470 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrzc8\" (UniqueName: \"kubernetes.io/projected/4a16488f-7114-48dd-9354-5b4e5b1cf71e-kube-api-access-hrzc8\") pod \"node-ca-gm67b\" (UID: \"4a16488f-7114-48dd-9354-5b4e5b1cf71e\") " pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:30.036285 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.036249 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:30.061364 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.061333 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lptz9" Jun 15 04:25:30.069221 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.069190 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:30.078763 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.078738 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g78tp" Jun 15 04:25:30.084395 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.084375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" Jun 15 04:25:30.091943 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.091919 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" Jun 15 04:25:30.097558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.097536 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9nndf" Jun 15 04:25:30.104185 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.104160 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kv7df" Jun 15 04:25:30.111797 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.111777 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:30.117296 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.117276 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gm67b" Jun 15 04:25:30.382171 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.382133 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:30.382360 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.382267 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:30.382360 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.382335 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:25:31.382317213 +0000 UTC m=+3.945612114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:30.483026 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.482985 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:30.483217 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.483094 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:30.483217 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.483149 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret podName:86e420ba-4a99-443e-92e3-86d4d76be538 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:31.483134912 +0000 UTC m=+4.046429814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret") pod "global-pull-secret-syncer-lwphn" (UID: "86e420ba-4a99-443e-92e3-86d4d76be538") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:30.584172 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.584134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:30.584356 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.584300 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:30.584356 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.584317 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:30.584356 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.584326 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fvbnp for pod openshift-network-diagnostics/network-check-target-4tght: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:30.584533 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:30.584389 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp podName:fca12851-aa26-45b5-ae7f-ddb4318e5fcb nodeName:}" failed. No retries permitted until 2026-06-15 04:25:31.584369744 +0000 UTC m=+4.147664646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvbnp" (UniqueName: "kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp") pod "network-check-target-4tght" (UID: "fca12851-aa26-45b5-ae7f-ddb4318e5fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:30.653435 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.653404 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8665ac9_1463_4b0f_a1b7_fe6ce746a3f9.slice/crio-d1b5ea84013fcf7e7e551aabfa49b706ba69a512eb8125cba34d1eceed656a77 WatchSource:0}: Error finding container d1b5ea84013fcf7e7e551aabfa49b706ba69a512eb8125cba34d1eceed656a77: Status 404 returned error can't find the container with id d1b5ea84013fcf7e7e551aabfa49b706ba69a512eb8125cba34d1eceed656a77 Jun 15 04:25:30.654563 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.654490 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a16488f_7114_48dd_9354_5b4e5b1cf71e.slice/crio-912e0ce65ff9335367c117e1f25d95edb799fcfc8b5182220022346c08f97336 WatchSource:0}: Error finding container 912e0ce65ff9335367c117e1f25d95edb799fcfc8b5182220022346c08f97336: Status 404 returned error can't find the container with id 912e0ce65ff9335367c117e1f25d95edb799fcfc8b5182220022346c08f97336 Jun 15 04:25:30.657950 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.657912 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71cf357_e4e1_4c59_924b_056e945e7e55.slice/crio-8fc588af297d55b786aeb73cea2163b092372d17c861555c0c1f6a218c76226a WatchSource:0}: Error finding container 8fc588af297d55b786aeb73cea2163b092372d17c861555c0c1f6a218c76226a: Status 404 returned error can't find the container with id 8fc588af297d55b786aeb73cea2163b092372d17c861555c0c1f6a218c76226a Jun 15 04:25:30.658645 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.658585 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df04f43_9cec_42cc_9567_1a9a0a36a049.slice/crio-18a8cab37268897b11c4165286c2bae4bb2386c26041cadf0d905b707a7d75d0 WatchSource:0}: Error finding container 18a8cab37268897b11c4165286c2bae4bb2386c26041cadf0d905b707a7d75d0: Status 404 returned error can't find the container with id 18a8cab37268897b11c4165286c2bae4bb2386c26041cadf0d905b707a7d75d0 Jun 15 04:25:30.659588 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.659492 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75ecff6_e96d_4a43_afe1_1c288fd1da65.slice/crio-e8c2bbe2ab45b581b07bd6dd366c8d716653f7c610d8ef9293fb54e0d85879e7 WatchSource:0}: Error finding container e8c2bbe2ab45b581b07bd6dd366c8d716653f7c610d8ef9293fb54e0d85879e7: Status 404 returned error can't find the container with id e8c2bbe2ab45b581b07bd6dd366c8d716653f7c610d8ef9293fb54e0d85879e7 Jun 15 04:25:30.660094 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.660076 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a165f07_7919_4ca4_aa9d_a1e5860a013b.slice/crio-576e87531fd0c094a9450910d546c277e970732b75580462e060554f2fdeec7b WatchSource:0}: Error finding container 576e87531fd0c094a9450910d546c277e970732b75580462e060554f2fdeec7b: Status 404 returned error can't find the container with id 576e87531fd0c094a9450910d546c277e970732b75580462e060554f2fdeec7b Jun 15 04:25:30.684223 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.684186 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1676af7_bcc1_4427_b25a_fca61b088bca.slice/crio-e325be7ea668dfbfa9b84864c179dbcdcc31f62c00b154f9dc14de89e4d7ce3f WatchSource:0}: Error finding container e325be7ea668dfbfa9b84864c179dbcdcc31f62c00b154f9dc14de89e4d7ce3f: Status 404 returned error can't find the container with id e325be7ea668dfbfa9b84864c179dbcdcc31f62c00b154f9dc14de89e4d7ce3f Jun 15 04:25:30.685369 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.685332 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa4f0d7_fd67_4607_bd66_83f8a56e7ead.slice/crio-3d5436442d1ccd333ed9091c59202a4a8971425e596b566944d4f206abda2b19 WatchSource:0}: Error finding container 3d5436442d1ccd333ed9091c59202a4a8971425e596b566944d4f206abda2b19: Status 404 returned error can't find the container with id 3d5436442d1ccd333ed9091c59202a4a8971425e596b566944d4f206abda2b19 Jun 15 04:25:30.685741 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:25:30.685704 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8646a2_3ef1_4b10_b0a4_2d3285297793.slice/crio-7ec96047043eec678175a7f83d37c95e9aae896c9ea4bb77969a4a6f315b65e1 WatchSource:0}: Error finding container 7ec96047043eec678175a7f83d37c95e9aae896c9ea4bb77969a4a6f315b65e1: Status 404 returned error can't find the container with id 7ec96047043eec678175a7f83d37c95e9aae896c9ea4bb77969a4a6f315b65e1 Jun 15 04:25:30.796692 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.796459 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 04:20:29 +0000 UTC" deadline="2028-03-29 19:47:28.207667576 +0000 UTC" Jun 15 04:25:30.796692 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.796695 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15687h21m57.410979891s" Jun 15 04:25:30.835548 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.835512 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" event={"ID":"9bab8913c76df9e2a70aeb901b774a32","Type":"ContainerStarted","Data":"f98af9175c536aa2fe22c868fb64d1d9ec772428d6763579ba8b03eeac0f5605"} Jun 15 04:25:30.838158 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.838131 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g78tp" event={"ID":"7b8646a2-3ef1-4b10-b0a4-2d3285297793","Type":"ContainerStarted","Data":"7ec96047043eec678175a7f83d37c95e9aae896c9ea4bb77969a4a6f315b65e1"} Jun 15 04:25:30.841101 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.841074 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerStarted","Data":"e325be7ea668dfbfa9b84864c179dbcdcc31f62c00b154f9dc14de89e4d7ce3f"} Jun 15 04:25:30.842095 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.842068 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" event={"ID":"7df04f43-9cec-42cc-9567-1a9a0a36a049","Type":"ContainerStarted","Data":"18a8cab37268897b11c4165286c2bae4bb2386c26041cadf0d905b707a7d75d0"} Jun 15 04:25:30.843935 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.843913 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kv7df" event={"ID":"b71cf357-e4e1-4c59-924b-056e945e7e55","Type":"ContainerStarted","Data":"8fc588af297d55b786aeb73cea2163b092372d17c861555c0c1f6a218c76226a"} Jun 15 04:25:30.847155 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.847133 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gm67b" event={"ID":"4a16488f-7114-48dd-9354-5b4e5b1cf71e","Type":"ContainerStarted","Data":"912e0ce65ff9335367c117e1f25d95edb799fcfc8b5182220022346c08f97336"} Jun 15 04:25:30.853003 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.852975 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"d1b5ea84013fcf7e7e551aabfa49b706ba69a512eb8125cba34d1eceed656a77"} Jun 15 04:25:30.854070 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.854046 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wdmg5" event={"ID":"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead","Type":"ContainerStarted","Data":"3d5436442d1ccd333ed9091c59202a4a8971425e596b566944d4f206abda2b19"} Jun 15 04:25:30.855079 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.855060 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9nndf" event={"ID":"6a165f07-7919-4ca4-aa9d-a1e5860a013b","Type":"ContainerStarted","Data":"576e87531fd0c094a9450910d546c277e970732b75580462e060554f2fdeec7b"} Jun 15 04:25:30.856050 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:30.856028 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lptz9" event={"ID":"a75ecff6-e96d-4a43-afe1-1c288fd1da65","Type":"ContainerStarted","Data":"e8c2bbe2ab45b581b07bd6dd366c8d716653f7c610d8ef9293fb54e0d85879e7"} Jun 15 04:25:31.389576 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.388989 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:31.389576 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.389146 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:31.389576 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.389213 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:25:33.389193005 +0000 UTC m=+5.952487913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:31.490032 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.489991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:31.490220 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.490128 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:31.490220 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.490191 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret podName:86e420ba-4a99-443e-92e3-86d4d76be538 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:33.490172861 +0000 UTC m=+6.053467778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret") pod "global-pull-secret-syncer-lwphn" (UID: "86e420ba-4a99-443e-92e3-86d4d76be538") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:31.590696 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.590604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:31.590883 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.590865 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:31.590955 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.590892 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:31.590955 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.590906 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fvbnp for pod openshift-network-diagnostics/network-check-target-4tght: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:31.591056 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.590968 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp podName:fca12851-aa26-45b5-ae7f-ddb4318e5fcb nodeName:}" failed. No retries permitted until 2026-06-15 04:25:33.59094987 +0000 UTC m=+6.154244792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvbnp" (UniqueName: "kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp") pod "network-check-target-4tght" (UID: "fca12851-aa26-45b5-ae7f-ddb4318e5fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:31.797410 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.797339 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 04:20:29 +0000 UTC" deadline="2027-12-15 23:46:30.398015665 +0000 UTC" Jun 15 04:25:31.797410 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.797407 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13171h20m58.600612507s" Jun 15 04:25:31.823844 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.823804 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:31.824010 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.823939 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:31.824367 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.824346 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:31.824486 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.824447 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:31.824546 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.824516 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:31.824608 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:31.824585 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:31.887798 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.887436 2554 generic.go:356] "Generic (PLEG): container finished" podID="8c413027eb0bb170f8771430424e22e4" containerID="ea9d88e9ab37bfc0e2224fcdb407ba46426c44089ea1512c23d0de48908698ee" exitCode=0 Jun 15 04:25:31.887798 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.887548 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" event={"ID":"8c413027eb0bb170f8771430424e22e4","Type":"ContainerDied","Data":"ea9d88e9ab37bfc0e2224fcdb407ba46426c44089ea1512c23d0de48908698ee"} Jun 15 04:25:31.902413 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:31.901932 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-236.ec2.internal" podStartSLOduration=3.9019124720000002 podStartE2EDuration="3.901912472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:30.847807469 +0000 UTC m=+3.411102417" watchObservedRunningTime="2026-06-15 04:25:31.901912472 +0000 UTC m=+4.465207398" Jun 15 04:25:32.910933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:32.910886 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" event={"ID":"8c413027eb0bb170f8771430424e22e4","Type":"ContainerStarted","Data":"93ea17574fc2e7d51e66a4ac59661d17720ed6b147b04b25cba01e898c3b2edd"} Jun 15 04:25:33.409375 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:33.409332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:33.409580 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.409528 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:33.409661 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.409595 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:25:37.409576074 +0000 UTC m=+9.972871011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:33.510072 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:33.510028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:33.510248 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.510188 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:33.510311 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.510250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret podName:86e420ba-4a99-443e-92e3-86d4d76be538 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:37.510232605 +0000 UTC m=+10.073527530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret") pod "global-pull-secret-syncer-lwphn" (UID: "86e420ba-4a99-443e-92e3-86d4d76be538") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:33.610515 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:33.610472 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:33.610735 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.610649 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:33.610735 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.610668 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:33.610735 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.610696 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fvbnp for pod openshift-network-diagnostics/network-check-target-4tght: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:33.610912 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.610758 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp podName:fca12851-aa26-45b5-ae7f-ddb4318e5fcb nodeName:}" failed. No retries permitted until 2026-06-15 04:25:37.610736974 +0000 UTC m=+10.174031902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvbnp" (UniqueName: "kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp") pod "network-check-target-4tght" (UID: "fca12851-aa26-45b5-ae7f-ddb4318e5fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:33.823799 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:33.823764 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:33.823973 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:33.823779 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:33.823973 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.823902 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:33.824096 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.824012 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:33.824096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:33.824063 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:33.824203 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:33.824136 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:35.823772 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:35.823685 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:35.823772 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:35.823724 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:35.824306 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:35.823834 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:35.824306 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:35.823687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:35.824306 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:35.824292 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:35.824463 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:35.824378 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:37.443224 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:37.443181 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:37.443690 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.443373 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:37.443690 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.443444 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:25:45.443424148 +0000 UTC m=+18.006719065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:37.544466 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:37.544422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:37.544658 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.544586 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:37.544764 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.544662 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret podName:86e420ba-4a99-443e-92e3-86d4d76be538 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:45.544643053 +0000 UTC m=+18.107937957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret") pod "global-pull-secret-syncer-lwphn" (UID: "86e420ba-4a99-443e-92e3-86d4d76be538") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:37.645256 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:37.645152 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:37.645430 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.645315 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:37.645430 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.645335 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:37.645430 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.645348 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fvbnp for pod openshift-network-diagnostics/network-check-target-4tght: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:37.645430 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.645410 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp podName:fca12851-aa26-45b5-ae7f-ddb4318e5fcb nodeName:}" failed. No retries permitted until 2026-06-15 04:25:45.645392793 +0000 UTC m=+18.208687710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvbnp" (UniqueName: "kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp") pod "network-check-target-4tght" (UID: "fca12851-aa26-45b5-ae7f-ddb4318e5fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:37.827487 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:37.825611 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:37.827487 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.825754 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:37.827487 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:37.826163 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:37.827487 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.826282 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:37.827487 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:37.827353 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:37.827487 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:37.827437 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:39.823969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:39.823884 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:39.823969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:39.823904 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:39.824516 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:39.824021 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:39.824516 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:39.824040 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:39.824516 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:39.824116 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:39.824516 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:39.824196 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:41.823809 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:41.823769 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:41.824258 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:41.823769 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:41.824258 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:41.823892 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:41.824258 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:41.823995 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:41.824258 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:41.823780 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:41.824258 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:41.824101 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:43.823516 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:43.823476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:43.824060 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:43.823478 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:43.824060 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:43.823606 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:43.824060 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:43.823711 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:43.824060 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:43.823485 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:43.824060 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:43.823789 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:45.501986 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:45.501895 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:45.502462 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.502058 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:45.502462 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.502132 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:26:01.502112082 +0000 UTC m=+34.065406984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:45.602935 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:45.602897 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:45.603107 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.603050 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:45.603159 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.603124 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret podName:86e420ba-4a99-443e-92e3-86d4d76be538 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:01.603108492 +0000 UTC m=+34.166403394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret") pod "global-pull-secret-syncer-lwphn" (UID: "86e420ba-4a99-443e-92e3-86d4d76be538") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:45.704064 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:45.704031 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:45.704235 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.704189 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:45.704235 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.704211 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:45.704235 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.704221 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fvbnp for pod openshift-network-diagnostics/network-check-target-4tght: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:45.704402 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.704281 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp podName:fca12851-aa26-45b5-ae7f-ddb4318e5fcb nodeName:}" failed. No retries permitted until 2026-06-15 04:26:01.704262779 +0000 UTC m=+34.267557681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvbnp" (UniqueName: "kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp") pod "network-check-target-4tght" (UID: "fca12851-aa26-45b5-ae7f-ddb4318e5fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:45.823271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:45.823231 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:45.823460 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:45.823231 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:45.823460 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.823369 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:45.823460 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:45.823230 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:45.823460 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.823422 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:45.823660 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:45.823481 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:47.824429 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:47.824352 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:47.824911 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:47.824457 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:47.824911 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:47.824469 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:47.824911 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:47.824570 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:47.824911 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:47.824612 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:47.824911 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:47.824705 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:49.826209 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.826184 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:49.826829 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.826285 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:49.826829 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:49.826300 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:49.826829 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.826311 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:49.826829 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:49.826365 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:49.826829 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:49.826429 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:49.949178 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.949145 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9nndf" event={"ID":"6a165f07-7919-4ca4-aa9d-a1e5860a013b","Type":"ContainerStarted","Data":"76fe7d678bb0c068428f89f27499914f548cc2f1ab370980b65b31a041b6fdb7"} Jun 15 04:25:49.950861 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.950831 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g78tp" event={"ID":"7b8646a2-3ef1-4b10-b0a4-2d3285297793","Type":"ContainerStarted","Data":"c60339370c2616b40c0e74b5d78bc3388f74abb143e9f631c3dd42e5defd62d5"} Jun 15 04:25:49.952864 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.952768 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1676af7-bcc1-4427-b25a-fca61b088bca" containerID="d473053da23756ef488be14f4d49c6a1f8232ec763bfbc58699a0aa0f5bdd537" exitCode=0 Jun 15 04:25:49.952864 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.952800 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerDied","Data":"d473053da23756ef488be14f4d49c6a1f8232ec763bfbc58699a0aa0f5bdd537"} Jun 15 04:25:49.954727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.954700 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" event={"ID":"7df04f43-9cec-42cc-9567-1a9a0a36a049","Type":"ContainerStarted","Data":"cd4474e2b616195970b8413126c5fb71fdd60ef64c48d3c72192aad56bced7dc"} Jun 15 04:25:49.956713 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.956609 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kv7df" event={"ID":"b71cf357-e4e1-4c59-924b-056e945e7e55","Type":"ContainerStarted","Data":"a33b1c08a7aef2f0b99321513c9b74abeb5291696aef092d12e8d680149bf091"} Jun 15 04:25:49.958122 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.958076 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gm67b" event={"ID":"4a16488f-7114-48dd-9354-5b4e5b1cf71e","Type":"ContainerStarted","Data":"52ed78a04d5555285154ca76cc7ba15565cf960650fa65df581d05c6e9175a9c"} Jun 15 04:25:49.960763 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.960745 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:25:49.961402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.961315 2554 generic.go:356] "Generic (PLEG): container finished" podID="b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9" containerID="cd409ecc5ae35cf8fb462c66a46ebbf94ae3d3cb342ee5959b886d4c6a4886ae" exitCode=1 Jun 15 04:25:49.961402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.961391 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"f9f3454c3372c59b4aea38c438a43ce165a4a59fc111e7ce7856807b9f30a877"} Jun 15 04:25:49.961543 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.961489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"0684c01adba8b93915fd904a166d93ea6cc98cc22e635c51113c932bb9504abd"} Jun 15 04:25:49.961543 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.961540 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"e4a5fd4cca6e57ca886944f54720481e99e8fda391726e565704e3de4d4d9a3c"} Jun 15 04:25:49.961643 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.961587 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerDied","Data":"cd409ecc5ae35cf8fb462c66a46ebbf94ae3d3cb342ee5959b886d4c6a4886ae"} Jun 15 04:25:49.961643 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.961638 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"4337caa1c5fc8829dfbeec13738289dd99b96636d24c288cc47ed1ed21fab8f1"} Jun 15 04:25:49.962906 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.962882 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wdmg5" event={"ID":"aaa4f0d7-fd67-4607-bd66-83f8a56e7ead","Type":"ContainerStarted","Data":"4234cc4bab34d91052b7c1bc316744c0eb749f98b5cb29527707e6b3c3793ce0"} Jun 15 04:25:49.965483 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.965429 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-236.ec2.internal" podStartSLOduration=21.965416825 podStartE2EDuration="21.965416825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:32.927350661 +0000 UTC m=+5.490645600" watchObservedRunningTime="2026-06-15 04:25:49.965416825 +0000 UTC m=+22.528711751" Jun 15 04:25:49.965590 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.965502 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9nndf" podStartSLOduration=4.112946893 podStartE2EDuration="22.965496152s" totalImagesPullingTime="18.852549259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:49.964974533 +0000 UTC m=+22.528269492" watchObservedRunningTime="2026-06-15 04:25:49.965496152 +0000 UTC m=+22.528791073" Jun 15 04:25:49.978303 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:49.978247 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gm67b" podStartSLOduration=3.533866527 podStartE2EDuration="21.978229601s" totalImagesPullingTime="18.444363074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:49.977856481 +0000 UTC m=+22.541151427" watchObservedRunningTime="2026-06-15 04:25:49.978229601 +0000 UTC m=+22.541524525" Jun 15 04:25:50.014260 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.014199 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wdmg5" podStartSLOduration=7.329045054 podStartE2EDuration="22.014180686s" totalImagesPullingTime="14.685135632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:50.013961347 +0000 UTC m=+22.577256272" watchObservedRunningTime="2026-06-15 04:25:50.014180686 +0000 UTC m=+22.577475610" Jun 15 04:25:50.028661 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.028607 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g78tp" podStartSLOduration=4.551820065 podStartE2EDuration="23.028583548s" totalImagesPullingTime="18.476763483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:50.028517241 +0000 UTC m=+22.591812189" watchObservedRunningTime="2026-06-15 04:25:50.028583548 +0000 UTC m=+22.591878473" Jun 15 04:25:50.755812 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.755783 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 04:25:50.825553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.825448 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T04:25:50.755808478Z","UUID":"469c2679-5b0d-402d-866e-461ecface2a3","Handler":null,"Name":"","Endpoint":""} Jun 15 04:25:50.827083 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.827058 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 04:25:50.827462 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.827104 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 04:25:50.967781 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.967691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lptz9" event={"ID":"a75ecff6-e96d-4a43-afe1-1c288fd1da65","Type":"ContainerStarted","Data":"89fc0237a360e5047bf7084d22f9352bf022e2f060669b8867b614bfdb16c024"} Jun 15 04:25:50.969944 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.969908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" event={"ID":"7df04f43-9cec-42cc-9567-1a9a0a36a049","Type":"ContainerStarted","Data":"744956b0e5430b6195380fb8f83500db20326cbb677736a9def81bedad359ac7"} Jun 15 04:25:50.973296 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.973276 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:25:50.973749 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.973722 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"97755c6695f670d1bdde26ce72b3a74d6194f52c3af2fd5f78fcc83de58183e8"} Jun 15 04:25:50.981632 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.981587 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kv7df" podStartSLOduration=5.496959081 podStartE2EDuration="23.981571697s" totalImagesPullingTime="18.484612616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:50.048830595 +0000 UTC m=+22.612125536" watchObservedRunningTime="2026-06-15 04:25:50.981571697 +0000 UTC m=+23.544866622" Jun 15 04:25:50.982205 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:50.982177 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lptz9" podStartSLOduration=5.493120162 podStartE2EDuration="23.98216667s" totalImagesPullingTime="18.489046508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:50.981798161 +0000 UTC m=+23.545093086" watchObservedRunningTime="2026-06-15 04:25:50.98216667 +0000 UTC m=+23.545461595" Jun 15 04:25:51.604130 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.604090 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:51.604666 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.604635 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:51.823769 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.823734 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:51.823935 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.823734 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:51.823935 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:51.823877 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:51.824017 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:51.823924 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:51.824017 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.823737 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:51.824104 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:51.824034 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:51.979340 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.979249 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" event={"ID":"7df04f43-9cec-42cc-9567-1a9a0a36a049","Type":"ContainerStarted","Data":"7a5da3a4ad81a2c1dc051f590e2f3604fc4d34b966a0f303df099c92994eb5fe"} Jun 15 04:25:51.979855 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.979814 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:51.980286 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.980266 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wdmg5" Jun 15 04:25:51.995558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:51.995504 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2d2kp" podStartSLOduration=4.50573661 podStartE2EDuration="24.995484931s" totalImagesPullingTime="20.489748321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:51.994844251 +0000 UTC m=+24.558139207" watchObservedRunningTime="2026-06-15 04:25:51.995484931 +0000 UTC m=+24.558779854" Jun 15 04:25:52.985469 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:52.985240 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:25:52.985962 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:52.985914 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"fc439f233a42bac10e5c76772813b2b0f149c88592e9e540274abe44b8023857"} Jun 15 04:25:53.823396 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:53.823360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:53.823553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:53.823362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:53.823553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:53.823501 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:53.823553 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:53.823498 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:53.823723 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:53.823625 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:53.823758 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:53.823724 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:54.993212 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:54.993048 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:25:54.994014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:54.993509 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"f1df809f4571d5ce0900604a26a35486e995ddff3564713c22f22e3bbfdc4292"} Jun 15 04:25:54.994014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:54.993741 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:54.994014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:54.993810 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:54.994014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:54.993982 2554 scope.go:117] "RemoveContainer" containerID="cd409ecc5ae35cf8fb462c66a46ebbf94ae3d3cb342ee5959b886d4c6a4886ae" Jun 15 04:25:54.995327 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:54.995300 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1676af7-bcc1-4427-b25a-fca61b088bca" containerID="ffe1be96719389573c8b81c181f02448db333fd2c3b9fd85ac04f6d14cac4e76" exitCode=0 Jun 15 04:25:54.995432 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:54.995340 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerDied","Data":"ffe1be96719389573c8b81c181f02448db333fd2c3b9fd85ac04f6d14cac4e76"} Jun 15 04:25:55.010847 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:55.010825 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:55.823406 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:55.823376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:55.823578 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:55.823377 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:55.823578 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:55.823377 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:55.823578 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:55.823535 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:55.823743 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:55.823645 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:55.823743 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:55.823726 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:56.000170 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.000091 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1676af7-bcc1-4427-b25a-fca61b088bca" containerID="d88c4554b746dfde648a73ffd1bc6a7d201f1fe14c5059f6b125458597642f00" exitCode=0 Jun 15 04:25:56.000576 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.000177 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerDied","Data":"d88c4554b746dfde648a73ffd1bc6a7d201f1fe14c5059f6b125458597642f00"} Jun 15 04:25:56.004200 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.004181 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:25:56.004565 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.004545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" event={"ID":"b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9","Type":"ContainerStarted","Data":"c2c8245947d4d43f5935fd1d19a4e242c98c72c2e35b8389dae3b532ede6edfb"} Jun 15 04:25:56.004782 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.004764 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:56.021038 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.021016 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:25:56.047200 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.046809 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" podStartSLOduration=10.507559446 podStartE2EDuration="29.046790552s" totalImagesPullingTime="18.539231106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:56.045878439 +0000 UTC m=+28.609173367" watchObservedRunningTime="2026-06-15 04:25:56.046790552 +0000 UTC m=+28.610085477" Jun 15 04:25:56.142557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.142523 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4tght"] Jun 15 04:25:56.142729 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.142655 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:56.142790 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:56.142767 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:56.146138 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.146101 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lwphn"] Jun 15 04:25:56.146280 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.146206 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:56.146349 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:56.146299 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:56.146767 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.146738 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tqgb2"] Jun 15 04:25:56.146932 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:56.146843 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:56.146998 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:56.146943 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:57.009459 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:57.009417 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1676af7-bcc1-4427-b25a-fca61b088bca" containerID="67a38577e433d16f946d5df419fdcfbb3cc9ab93c3efb66b763c802e5cdeba7b" exitCode=0 Jun 15 04:25:57.009956 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:57.009506 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerDied","Data":"67a38577e433d16f946d5df419fdcfbb3cc9ab93c3efb66b763c802e5cdeba7b"} Jun 15 04:25:57.824027 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:57.823997 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:57.824215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:57.824071 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:57.824215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:57.824114 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:57.824215 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:57.824178 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:25:57.824361 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:57.824196 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:57.827909 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:57.824250 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:59.823818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:59.823612 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:25:59.824250 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:59.823621 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:25:59.824250 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:59.823910 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:25:59.824250 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:25:59.823637 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:25:59.824250 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:59.823976 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:25:59.824250 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:25:59.824084 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:26:01.528115 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:01.528086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:26:01.528536 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.528234 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:26:01.528536 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.528310 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:26:33.528288624 +0000 UTC m=+66.091583529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:26:01.629434 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:01.629358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:26:01.629657 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.629501 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:26:01.629657 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.629573 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret podName:86e420ba-4a99-443e-92e3-86d4d76be538 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:33.629557842 +0000 UTC m=+66.192852745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret") pod "global-pull-secret-syncer-lwphn" (UID: "86e420ba-4a99-443e-92e3-86d4d76be538") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:26:01.730591 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:01.730556 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:26:01.730796 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.730714 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:26:01.730796 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.730730 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:26:01.730796 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.730739 2554 projected.go:196] Error preparing data for projected volume kube-api-access-fvbnp for pod openshift-network-diagnostics/network-check-target-4tght: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:26:01.730796 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.730787 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp podName:fca12851-aa26-45b5-ae7f-ddb4318e5fcb nodeName:}" failed. No retries permitted until 2026-06-15 04:26:33.730774629 +0000 UTC m=+66.294069531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvbnp" (UniqueName: "kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp") pod "network-check-target-4tght" (UID: "fca12851-aa26-45b5-ae7f-ddb4318e5fcb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:26:01.823647 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:01.823614 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:26:01.823877 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:01.823615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:26:01.823877 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.823746 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4tght" podUID="fca12851-aa26-45b5-ae7f-ddb4318e5fcb" Jun 15 04:26:01.823877 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:01.823616 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:26:01.823877 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.823847 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:26:01.824045 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:01.823934 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lwphn" podUID="86e420ba-4a99-443e-92e3-86d4d76be538" Jun 15 04:26:02.023889 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.023853 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1676af7-bcc1-4427-b25a-fca61b088bca" containerID="00e8b573b47eea4f520ea6232c85712f43ab24400a5a72603219c16cecc41c6c" exitCode=0 Jun 15 04:26:02.024065 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.023903 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerDied","Data":"00e8b573b47eea4f520ea6232c85712f43ab24400a5a72603219c16cecc41c6c"} Jun 15 04:26:02.230004 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.229978 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-236.ec2.internal" event="NodeReady" Jun 15 04:26:02.230148 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.230112 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 04:26:02.269609 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.269581 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fhkm2"] Jun 15 04:26:02.279934 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.279895 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-clxdp"] Jun 15 04:26:02.280076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.280015 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.283738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.283220 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zvtcp\"" Jun 15 04:26:02.283738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.283480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 04:26:02.285396 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.284037 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 04:26:02.292685 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.292650 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhkm2"] Jun 15 04:26:02.292786 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.292747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.292786 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.292770 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clxdp"] Jun 15 04:26:02.295142 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.295119 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 04:26:02.295235 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.295174 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kc4cf\"" Jun 15 04:26:02.295235 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.295124 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 04:26:02.295304 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.295199 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 04:26:02.435996 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.435956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c48lx\" (UniqueName: \"kubernetes.io/projected/7cd4563d-c0e0-463e-b183-b74a32d1ef66-kube-api-access-c48lx\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.435996 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.435997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd4563d-c0e0-463e-b183-b74a32d1ef66-config-volume\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.436207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.436024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.436207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.436104 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79938686-4627-46c4-83fd-13a544b741c2-cert\") pod \"ingress-canary-clxdp\" (UID: \"79938686-4627-46c4-83fd-13a544b741c2\") " pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.436207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.436143 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd4563d-c0e0-463e-b183-b74a32d1ef66-tmp-dir\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.436207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.436175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4wq7\" (UniqueName: \"kubernetes.io/projected/79938686-4627-46c4-83fd-13a544b741c2-kube-api-access-w4wq7\") pod \"ingress-canary-clxdp\" (UID: \"79938686-4627-46c4-83fd-13a544b741c2\") " pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.537289 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79938686-4627-46c4-83fd-13a544b741c2-cert\") pod \"ingress-canary-clxdp\" (UID: \"79938686-4627-46c4-83fd-13a544b741c2\") " pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd4563d-c0e0-463e-b183-b74a32d1ef66-tmp-dir\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4wq7\" (UniqueName: \"kubernetes.io/projected/79938686-4627-46c4-83fd-13a544b741c2-kube-api-access-w4wq7\") pod \"ingress-canary-clxdp\" (UID: \"79938686-4627-46c4-83fd-13a544b741c2\") " pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537369 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c48lx\" (UniqueName: \"kubernetes.io/projected/7cd4563d-c0e0-463e-b183-b74a32d1ef66-kube-api-access-c48lx\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd4563d-c0e0-463e-b183-b74a32d1ef66-config-volume\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:02.537506 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:02.537564 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:03.037549052 +0000 UTC m=+35.600843977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:26:02.537933 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537710 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd4563d-c0e0-463e-b183-b74a32d1ef66-tmp-dir\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.538274 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.537948 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd4563d-c0e0-463e-b183-b74a32d1ef66-config-volume\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.541532 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.541513 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79938686-4627-46c4-83fd-13a544b741c2-cert\") pod \"ingress-canary-clxdp\" (UID: \"79938686-4627-46c4-83fd-13a544b741c2\") " pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.545890 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.545862 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c48lx\" (UniqueName: \"kubernetes.io/projected/7cd4563d-c0e0-463e-b183-b74a32d1ef66-kube-api-access-c48lx\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:02.546011 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.545985 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4wq7\" (UniqueName: \"kubernetes.io/projected/79938686-4627-46c4-83fd-13a544b741c2-kube-api-access-w4wq7\") pod \"ingress-canary-clxdp\" (UID: \"79938686-4627-46c4-83fd-13a544b741c2\") " pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.600963 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.600926 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clxdp" Jun 15 04:26:02.819630 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:02.819393 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clxdp"] Jun 15 04:26:02.823030 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:26:02.823004 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79938686_4627_46c4_83fd_13a544b741c2.slice/crio-1f69d89721be3b9e5727c4deb2c1c517047bd6d70b914c4a05b66f7784364406 WatchSource:0}: Error finding container 1f69d89721be3b9e5727c4deb2c1c517047bd6d70b914c4a05b66f7784364406: Status 404 returned error can't find the container with id 1f69d89721be3b9e5727c4deb2c1c517047bd6d70b914c4a05b66f7784364406 Jun 15 04:26:03.027036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.026999 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clxdp" event={"ID":"79938686-4627-46c4-83fd-13a544b741c2","Type":"ContainerStarted","Data":"1f69d89721be3b9e5727c4deb2c1c517047bd6d70b914c4a05b66f7784364406"} Jun 15 04:26:03.029746 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.029718 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1676af7-bcc1-4427-b25a-fca61b088bca" containerID="00413577250c1e61b746e8a8ef337e4265d23ef47554f923caa336fb1dfa6b99" exitCode=0 Jun 15 04:26:03.029856 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.029770 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerDied","Data":"00413577250c1e61b746e8a8ef337e4265d23ef47554f923caa336fb1dfa6b99"} Jun 15 04:26:03.041297 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.041276 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:03.041397 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:03.041388 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:03.041457 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:03.041447 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:04.041426147 +0000 UTC m=+36.604721049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:26:03.823352 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.823322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:26:03.824121 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.823322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:26:03.824121 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.823330 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:26:03.825944 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.825924 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 04:26:03.827290 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.827248 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8s6z2\"" Jun 15 04:26:03.827290 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.827278 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 04:26:03.827569 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.827294 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjm9q\"" Jun 15 04:26:03.827569 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.827297 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 04:26:03.827569 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:03.827432 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 04:26:04.036204 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:04.036174 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" event={"ID":"c1676af7-bcc1-4427-b25a-fca61b088bca","Type":"ContainerStarted","Data":"e2a79e3672f3245490a0006d8c6de5457f4b16b02682b12fd50b841e19fac3b4"} Jun 15 04:26:04.047622 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:04.047587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:04.047814 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:04.047766 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:04.047882 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:04.047832 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:06.047811672 +0000 UTC m=+38.611106576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:26:04.059339 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:04.059261 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sz2kd" podStartSLOduration=8.924539868 podStartE2EDuration="37.059241057s" totalImagesPullingTime="28.134701189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:04.05763449 +0000 UTC m=+36.620929415" watchObservedRunningTime="2026-06-15 04:26:04.059241057 +0000 UTC m=+36.622535981" Jun 15 04:26:05.040821 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:05.040480 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clxdp" event={"ID":"79938686-4627-46c4-83fd-13a544b741c2","Type":"ContainerStarted","Data":"cd4cd52129ae112c47940bf9302983ff97dd9bbb57c04c614df7010f47035078"} Jun 15 04:26:06.061793 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:06.061752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:06.062263 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:06.061883 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:06.062263 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:06.061970 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:10.061952207 +0000 UTC m=+42.625247112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:26:10.088972 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:10.088923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:10.089499 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:10.089069 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:10.089499 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:10.089142 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:18.089121395 +0000 UTC m=+50.652416299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:26:18.143019 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:18.142972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:18.143703 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:18.143153 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:18.143703 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:18.143237 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:34.143214403 +0000 UTC m=+66.706509308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:26:28.023232 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:28.023204 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g9xbf" Jun 15 04:26:28.052042 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:28.051986 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-clxdp" podStartSLOduration=23.968565996 podStartE2EDuration="26.051955344s" totalImagesPullingTime="2.083389348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:05.055010646 +0000 UTC m=+37.618305571" watchObservedRunningTime="2026-06-15 04:26:28.051955344 +0000 UTC m=+60.615250259" Jun 15 04:26:33.550198 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.550158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:26:33.553011 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.552991 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 04:26:33.561038 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:33.561014 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 04:26:33.561094 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:33.561081 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:27:37.561065591 +0000 UTC m=+130.124360497 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : secret "metrics-daemon-secret" not found Jun 15 04:26:33.650576 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.650537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:26:33.653281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.653262 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 04:26:33.665174 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.665148 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/86e420ba-4a99-443e-92e3-86d4d76be538-original-pull-secret\") pod \"global-pull-secret-syncer-lwphn\" (UID: \"86e420ba-4a99-443e-92e3-86d4d76be538\") " pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:26:33.751659 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.751612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:26:33.754161 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.754140 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 04:26:33.764433 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.764404 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 04:26:33.774777 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.774751 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvbnp\" (UniqueName: \"kubernetes.io/projected/fca12851-aa26-45b5-ae7f-ddb4318e5fcb-kube-api-access-fvbnp\") pod \"network-check-target-4tght\" (UID: \"fca12851-aa26-45b5-ae7f-ddb4318e5fcb\") " pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:26:33.835857 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.835768 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lwphn" Jun 15 04:26:33.845213 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.845185 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjm9q\"" Jun 15 04:26:33.853435 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:33.853407 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:26:34.005461 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:34.005419 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lwphn"] Jun 15 04:26:34.008714 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:26:34.008659 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e420ba_4a99_443e_92e3_86d4d76be538.slice/crio-d80148284de9888a6bb7b10d20aa96a0c66ebba8b04e1bc17dd7de393fb80e3a WatchSource:0}: Error finding container d80148284de9888a6bb7b10d20aa96a0c66ebba8b04e1bc17dd7de393fb80e3a: Status 404 returned error can't find the container with id d80148284de9888a6bb7b10d20aa96a0c66ebba8b04e1bc17dd7de393fb80e3a Jun 15 04:26:34.027428 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:34.027391 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4tght"] Jun 15 04:26:34.030143 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:26:34.030111 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca12851_aa26_45b5_ae7f_ddb4318e5fcb.slice/crio-102532e709db89326e689bc65e964de48172b8dea5345d9d1f7cf5237742590d WatchSource:0}: Error finding container 102532e709db89326e689bc65e964de48172b8dea5345d9d1f7cf5237742590d: Status 404 returned error can't find the container with id 102532e709db89326e689bc65e964de48172b8dea5345d9d1f7cf5237742590d Jun 15 04:26:34.110887 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:34.110767 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4tght" event={"ID":"fca12851-aa26-45b5-ae7f-ddb4318e5fcb","Type":"ContainerStarted","Data":"102532e709db89326e689bc65e964de48172b8dea5345d9d1f7cf5237742590d"} Jun 15 04:26:34.111771 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:34.111749 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lwphn" event={"ID":"86e420ba-4a99-443e-92e3-86d4d76be538","Type":"ContainerStarted","Data":"d80148284de9888a6bb7b10d20aa96a0c66ebba8b04e1bc17dd7de393fb80e3a"} Jun 15 04:26:34.158286 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:34.158241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:26:34.158452 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:34.158361 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:34.158452 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:26:34.158414 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:27:06.158398978 +0000 UTC m=+98.721693881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:26:39.127662 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:39.127623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4tght" event={"ID":"fca12851-aa26-45b5-ae7f-ddb4318e5fcb","Type":"ContainerStarted","Data":"d671e387ae944f43d4298fd4eae8c6135e80bf1dad2c56b3284ab32308152aa5"} Jun 15 04:26:39.128197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:39.127743 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:26:39.129059 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:39.129038 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lwphn" event={"ID":"86e420ba-4a99-443e-92e3-86d4d76be538","Type":"ContainerStarted","Data":"904e1f12f0021ef8a01f9ea7ed20a8d4d20164cfa4538081eafb25716d16de6b"} Jun 15 04:26:39.142604 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:39.142546 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4tght" podStartSLOduration=66.847141315 podStartE2EDuration="1m11.14253176s" totalImagesPullingTime="4.295390445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:39.141743885 +0000 UTC m=+71.705038825" watchObservedRunningTime="2026-06-15 04:26:39.14253176 +0000 UTC m=+71.705826684" Jun 15 04:26:39.154973 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:26:39.154920 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lwphn" podStartSLOduration=66.834628537 podStartE2EDuration="1m11.154905017s" totalImagesPullingTime="4.32027648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:39.154520929 +0000 UTC m=+71.717815853" watchObservedRunningTime="2026-06-15 04:26:39.154905017 +0000 UTC m=+71.718199972" Jun 15 04:27:06.178595 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:27:06.178540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:27:06.179054 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:27:06.178719 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:27:06.179054 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:27:06.178797 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:28:10.178781064 +0000 UTC m=+162.742075965 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:27:10.133809 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:27:10.133776 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4tght" Jun 15 04:27:37.585381 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:27:37.585324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:27:37.585911 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:27:37.585485 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 04:27:37.585911 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:27:37.585562 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs podName:8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f nodeName:}" failed. No retries permitted until 2026-06-15 04:29:39.585544418 +0000 UTC m=+252.148839320 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs") pod "network-metrics-daemon-tqgb2" (UID: "8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f") : secret "metrics-daemon-secret" not found Jun 15 04:28:05.294092 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:28:05.294042 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fhkm2" podUID="7cd4563d-c0e0-463e-b183-b74a32d1ef66" Jun 15 04:28:05.335375 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:28:05.335349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhkm2" Jun 15 04:28:06.848950 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:28:06.848902 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tqgb2" podUID="8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f" Jun 15 04:28:10.205969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:28:10.205899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:28:10.206352 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:28:10.206022 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:28:10.206352 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:28:10.206076 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls podName:7cd4563d-c0e0-463e-b183-b74a32d1ef66 nodeName:}" failed. No retries permitted until 2026-06-15 04:30:12.206061885 +0000 UTC m=+284.769356787 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls") pod "dns-default-fhkm2" (UID: "7cd4563d-c0e0-463e-b183-b74a32d1ef66") : secret "dns-default-metrics-tls" not found Jun 15 04:28:17.824283 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:28:17.824222 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:29:02.115775 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.115735 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4"] Jun 15 04:29:02.117218 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.117197 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zxq74"] Jun 15 04:29:02.117355 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.117318 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.118573 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.118553 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-6xbp2"] Jun 15 04:29:02.118721 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.118701 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.119807 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.119782 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wrjkw\"" Jun 15 04:29:02.119894 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.119843 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.120947 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.120931 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.121474 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.121454 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 15 04:29:02.121474 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.121469 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.121641 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.121505 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 15 04:29:02.121641 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.121565 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 15 04:29:02.121641 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.121585 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rtjc8\"" Jun 15 04:29:02.121641 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.121627 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.122004 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.121988 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 15 04:29:02.122733 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.122718 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.122984 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.122966 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.123164 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.123137 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 15 04:29:02.123287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.123154 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.124499 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.124475 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jgjxh\"" Jun 15 04:29:02.128721 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.128700 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 15 04:29:02.131311 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.131251 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4"] Jun 15 04:29:02.133278 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.133258 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zxq74"] Jun 15 04:29:02.133607 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.133585 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 15 04:29:02.135400 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.135376 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 15 04:29:02.135999 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.135977 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-6xbp2"] Jun 15 04:29:02.153815 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.153790 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.153948 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.153820 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9b0df88-f0d9-4a95-8159-728a6e4f8633-serving-cert\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.153948 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.153840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a9b0df88-f0d9-4a95-8159-728a6e4f8633-snapshots\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.153948 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.153859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b0df88-f0d9-4a95-8159-728a6e4f8633-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.154076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.153942 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9b0df88-f0d9-4a95-8159-728a6e4f8633-tmp\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.154076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.153968 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr7xs\" (UniqueName: \"kubernetes.io/projected/a9b0df88-f0d9-4a95-8159-728a6e4f8633-kube-api-access-vr7xs\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.154076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.154013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b0df88-f0d9-4a95-8159-728a6e4f8633-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.154076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.154030 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde07d4b-ea1f-4221-b9d8-92775b213ac1-trusted-ca\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.154076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.154051 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92eb6924-4d9f-4306-a45d-4a89cd012bff-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.154236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.154105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srbwc\" (UniqueName: \"kubernetes.io/projected/92eb6924-4d9f-4306-a45d-4a89cd012bff-kube-api-access-srbwc\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.154236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.154126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fde07d4b-ea1f-4221-b9d8-92775b213ac1-serving-cert\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.154236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.154142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppgrt\" (UniqueName: \"kubernetes.io/projected/fde07d4b-ea1f-4221-b9d8-92775b213ac1-kube-api-access-ppgrt\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.154236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.154166 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fde07d4b-ea1f-4221-b9d8-92775b213ac1-config\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.207538 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.207505 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-n2j57"] Jun 15 04:29:02.209249 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.209233 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" Jun 15 04:29:02.210883 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.210858 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f"] Jun 15 04:29:02.211626 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.211598 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2pp74\"" Jun 15 04:29:02.212189 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.212171 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s"] Jun 15 04:29:02.212292 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.212281 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.213634 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.213616 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74f46d5878-vxjd7"] Jun 15 04:29:02.213751 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.213737 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" Jun 15 04:29:02.214625 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.214608 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 15 04:29:02.214782 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.214646 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fc29t\"" Jun 15 04:29:02.214782 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.214746 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.214782 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.214763 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 15 04:29:02.214994 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.214763 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.215154 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.215140 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.215947 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.215930 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.216042 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.216029 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.216227 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.216213 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bhrzq\"" Jun 15 04:29:02.217392 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.217372 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 15 04:29:02.217541 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.217377 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 15 04:29:02.217656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.217628 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 15 04:29:02.217764 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.217630 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.217981 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.217961 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 15 04:29:02.217981 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.217981 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.218117 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.217998 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5gzzh\"" Jun 15 04:29:02.221810 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.221770 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-n2j57"] Jun 15 04:29:02.222720 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.222702 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s"] Jun 15 04:29:02.225805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.225783 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f"] Jun 15 04:29:02.238268 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.238249 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74f46d5878-vxjd7"] Jun 15 04:29:02.254410 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254383 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b0df88-f0d9-4a95-8159-728a6e4f8633-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.254410 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9b0df88-f0d9-4a95-8159-728a6e4f8633-tmp\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.254624 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254437 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03dc7bbd-02d6-48b2-afcd-9ec86140d085-config\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.254624 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254457 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde07d4b-ea1f-4221-b9d8-92775b213ac1-trusted-ca\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.254624 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92eb6924-4d9f-4306-a45d-4a89cd012bff-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.254792 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-default-certificate\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.254792 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254654 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2g65\" (UniqueName: \"kubernetes.io/projected/e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2-kube-api-access-m2g65\") pod \"network-check-source-6947749cfc-n2j57\" (UID: \"e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" Jun 15 04:29:02.254792 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppgrt\" (UniqueName: \"kubernetes.io/projected/fde07d4b-ea1f-4221-b9d8-92775b213ac1-kube-api-access-ppgrt\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.254903 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03dc7bbd-02d6-48b2-afcd-9ec86140d085-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.254903 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254835 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.254903 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fde07d4b-ea1f-4221-b9d8-92775b213ac1-config\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.255036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.255036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254922 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9b0df88-f0d9-4a95-8159-728a6e4f8633-tmp\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.255036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254928 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a9b0df88-f0d9-4a95-8159-728a6e4f8633-snapshots\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.255036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.254983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr7xs\" (UniqueName: \"kubernetes.io/projected/a9b0df88-f0d9-4a95-8159-728a6e4f8633-kube-api-access-vr7xs\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.255036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255017 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.255287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-stats-auth\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.255287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255116 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b0df88-f0d9-4a95-8159-728a6e4f8633-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.255287 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.255138 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:02.255287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lzwv\" (UniqueName: \"kubernetes.io/projected/950cdc0f-8e01-4894-86b6-152cd8573bd3-kube-api-access-2lzwv\") pod \"volume-data-source-validator-bd4ccd799-nps7s\" (UID: \"950cdc0f-8e01-4894-86b6-152cd8573bd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" Jun 15 04:29:02.255287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sjsh\" (UniqueName: \"kubernetes.io/projected/d41d8e9b-3491-4d50-8451-424688a6347e-kube-api-access-8sjsh\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.255287 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.255217 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls podName:92eb6924-4d9f-4306-a45d-4a89cd012bff nodeName:}" failed. No retries permitted until 2026-06-15 04:29:02.755199274 +0000 UTC m=+215.318494193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wcxv4" (UID: "92eb6924-4d9f-4306-a45d-4a89cd012bff") : secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:02.255287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b0df88-f0d9-4a95-8159-728a6e4f8633-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255308 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srbwc\" (UniqueName: \"kubernetes.io/projected/92eb6924-4d9f-4306-a45d-4a89cd012bff-kube-api-access-srbwc\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255350 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8chpm\" (UniqueName: \"kubernetes.io/projected/03dc7bbd-02d6-48b2-afcd-9ec86140d085-kube-api-access-8chpm\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255368 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92eb6924-4d9f-4306-a45d-4a89cd012bff-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255379 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fde07d4b-ea1f-4221-b9d8-92775b213ac1-serving-cert\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9b0df88-f0d9-4a95-8159-728a6e4f8633-serving-cert\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255501 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fde07d4b-ea1f-4221-b9d8-92775b213ac1-trusted-ca\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255540 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a9b0df88-f0d9-4a95-8159-728a6e4f8633-snapshots\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.255665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.255546 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fde07d4b-ea1f-4221-b9d8-92775b213ac1-config\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.256024 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.256003 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b0df88-f0d9-4a95-8159-728a6e4f8633-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.257612 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.257593 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fde07d4b-ea1f-4221-b9d8-92775b213ac1-serving-cert\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.257728 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.257637 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9b0df88-f0d9-4a95-8159-728a6e4f8633-serving-cert\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.264588 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.264561 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppgrt\" (UniqueName: \"kubernetes.io/projected/fde07d4b-ea1f-4221-b9d8-92775b213ac1-kube-api-access-ppgrt\") pod \"console-operator-5dbbb5d744-6xbp2\" (UID: \"fde07d4b-ea1f-4221-b9d8-92775b213ac1\") " pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.265215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.265197 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr7xs\" (UniqueName: \"kubernetes.io/projected/a9b0df88-f0d9-4a95-8159-728a6e4f8633-kube-api-access-vr7xs\") pod \"insights-operator-5bbd86d6bd-zxq74\" (UID: \"a9b0df88-f0d9-4a95-8159-728a6e4f8633\") " pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.265477 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.265460 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srbwc\" (UniqueName: \"kubernetes.io/projected/92eb6924-4d9f-4306-a45d-4a89cd012bff-kube-api-access-srbwc\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.355903 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.355861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03dc7bbd-02d6-48b2-afcd-9ec86140d085-config\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.355903 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.355913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-default-certificate\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.355932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2g65\" (UniqueName: \"kubernetes.io/projected/e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2-kube-api-access-m2g65\") pod \"network-check-source-6947749cfc-n2j57\" (UID: \"e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.355970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03dc7bbd-02d6-48b2-afcd-9ec86140d085-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.355986 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.356014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.356037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-stats-auth\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.356054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lzwv\" (UniqueName: \"kubernetes.io/projected/950cdc0f-8e01-4894-86b6-152cd8573bd3-kube-api-access-2lzwv\") pod \"volume-data-source-validator-bd4ccd799-nps7s\" (UID: \"950cdc0f-8e01-4894-86b6-152cd8573bd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.356084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sjsh\" (UniqueName: \"kubernetes.io/projected/d41d8e9b-3491-4d50-8451-424688a6347e-kube-api-access-8sjsh\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.356127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8chpm\" (UniqueName: \"kubernetes.io/projected/03dc7bbd-02d6-48b2-afcd-9ec86140d085-kube-api-access-8chpm\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.356180 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.356149 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 04:29:02.356581 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.356244 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:02.856221434 +0000 UTC m=+215.419516336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : secret "router-metrics-certs-default" not found Jun 15 04:29:02.356581 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.356359 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:02.856343679 +0000 UTC m=+215.419638603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : configmap references non-existent config key: service-ca.crt Jun 15 04:29:02.356731 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.356595 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03dc7bbd-02d6-48b2-afcd-9ec86140d085-config\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.358427 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.358396 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03dc7bbd-02d6-48b2-afcd-9ec86140d085-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.358532 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.358511 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-stats-auth\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.358576 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.358556 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-default-certificate\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.364950 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.364906 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2g65\" (UniqueName: \"kubernetes.io/projected/e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2-kube-api-access-m2g65\") pod \"network-check-source-6947749cfc-n2j57\" (UID: \"e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" Jun 15 04:29:02.365076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.364961 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8chpm\" (UniqueName: \"kubernetes.io/projected/03dc7bbd-02d6-48b2-afcd-9ec86140d085-kube-api-access-8chpm\") pod \"service-ca-operator-7ccbfd59dc-22r4f\" (UID: \"03dc7bbd-02d6-48b2-afcd-9ec86140d085\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.365076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.365067 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lzwv\" (UniqueName: \"kubernetes.io/projected/950cdc0f-8e01-4894-86b6-152cd8573bd3-kube-api-access-2lzwv\") pod \"volume-data-source-validator-bd4ccd799-nps7s\" (UID: \"950cdc0f-8e01-4894-86b6-152cd8573bd3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" Jun 15 04:29:02.365161 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.365103 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sjsh\" (UniqueName: \"kubernetes.io/projected/d41d8e9b-3491-4d50-8451-424688a6347e-kube-api-access-8sjsh\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.439486 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.439394 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" Jun 15 04:29:02.445019 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.444991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:02.519819 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.519781 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" Jun 15 04:29:02.526428 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.526402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" Jun 15 04:29:02.534343 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.534315 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" Jun 15 04:29:02.577784 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.577750 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-zxq74"] Jun 15 04:29:02.591028 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.590949 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-6xbp2"] Jun 15 04:29:02.610433 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:02.598502 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde07d4b_ea1f_4221_b9d8_92775b213ac1.slice/crio-2bd5534f1d25934b94ab1a683a632e19aa987b929650c40746e0d4db0ca38d46 WatchSource:0}: Error finding container 2bd5534f1d25934b94ab1a683a632e19aa987b929650c40746e0d4db0ca38d46: Status 404 returned error can't find the container with id 2bd5534f1d25934b94ab1a683a632e19aa987b929650c40746e0d4db0ca38d46 Jun 15 04:29:02.671460 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:02.671433 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bcd3fc_8cf2_4232_91e2_f92a1a1bdce2.slice/crio-1d664645b2242b8bec8d81b8252e397daff2dabbc02c50903e2f1a19ca7d75d5 WatchSource:0}: Error finding container 1d664645b2242b8bec8d81b8252e397daff2dabbc02c50903e2f1a19ca7d75d5: Status 404 returned error can't find the container with id 1d664645b2242b8bec8d81b8252e397daff2dabbc02c50903e2f1a19ca7d75d5 Jun 15 04:29:02.674214 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.674186 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-n2j57"] Jun 15 04:29:02.686228 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.686204 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f"] Jun 15 04:29:02.688997 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:02.688941 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03dc7bbd_02d6_48b2_afcd_9ec86140d085.slice/crio-899febdc43140cd42fd26bcb763f1e8a0d43a90d51d74d135318bfe0ee0e1c58 WatchSource:0}: Error finding container 899febdc43140cd42fd26bcb763f1e8a0d43a90d51d74d135318bfe0ee0e1c58: Status 404 returned error can't find the container with id 899febdc43140cd42fd26bcb763f1e8a0d43a90d51d74d135318bfe0ee0e1c58 Jun 15 04:29:02.704493 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.704465 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s"] Jun 15 04:29:02.708207 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:02.708182 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950cdc0f_8e01_4894_86b6_152cd8573bd3.slice/crio-5ef9d49334ffdc28b555a23df2bfe967e10f0c641d173a931693fda96d0e53ec WatchSource:0}: Error finding container 5ef9d49334ffdc28b555a23df2bfe967e10f0c641d173a931693fda96d0e53ec: Status 404 returned error can't find the container with id 5ef9d49334ffdc28b555a23df2bfe967e10f0c641d173a931693fda96d0e53ec Jun 15 04:29:02.759248 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.759212 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:02.759406 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.759362 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:02.759454 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.759423 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls podName:92eb6924-4d9f-4306-a45d-4a89cd012bff nodeName:}" failed. No retries permitted until 2026-06-15 04:29:03.759408418 +0000 UTC m=+216.322703321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wcxv4" (UID: "92eb6924-4d9f-4306-a45d-4a89cd012bff") : secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:02.859931 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.859894 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.860111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:02.859952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:02.860111 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.860065 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:03.860043539 +0000 UTC m=+216.423338446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : configmap references non-existent config key: service-ca.crt Jun 15 04:29:02.860111 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.860065 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 04:29:02.860111 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:02.860107 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:03.860097157 +0000 UTC m=+216.423392059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : secret "router-metrics-certs-default" not found Jun 15 04:29:03.478460 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.478415 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" event={"ID":"fde07d4b-ea1f-4221-b9d8-92775b213ac1","Type":"ContainerStarted","Data":"2bd5534f1d25934b94ab1a683a632e19aa987b929650c40746e0d4db0ca38d46"} Jun 15 04:29:03.481827 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.481090 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" event={"ID":"e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2","Type":"ContainerStarted","Data":"ca343d70421038597f54e122dd24fb04385d6fa2c11108a47c90bb2c1affe13b"} Jun 15 04:29:03.481827 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.481138 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" event={"ID":"e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2","Type":"ContainerStarted","Data":"1d664645b2242b8bec8d81b8252e397daff2dabbc02c50903e2f1a19ca7d75d5"} Jun 15 04:29:03.483516 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.483454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" event={"ID":"a9b0df88-f0d9-4a95-8159-728a6e4f8633","Type":"ContainerStarted","Data":"eac8c2afd9c4c3bf4456d06dcb7f09745928db4614937c2d3386f8605d7fcd49"} Jun 15 04:29:03.486275 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.486217 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" event={"ID":"950cdc0f-8e01-4894-86b6-152cd8573bd3","Type":"ContainerStarted","Data":"5ef9d49334ffdc28b555a23df2bfe967e10f0c641d173a931693fda96d0e53ec"} Jun 15 04:29:03.489399 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.489324 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" event={"ID":"03dc7bbd-02d6-48b2-afcd-9ec86140d085","Type":"ContainerStarted","Data":"899febdc43140cd42fd26bcb763f1e8a0d43a90d51d74d135318bfe0ee0e1c58"} Jun 15 04:29:03.768294 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.767972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:03.768476 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:03.768295 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:03.768476 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:03.768370 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls podName:92eb6924-4d9f-4306-a45d-4a89cd012bff nodeName:}" failed. No retries permitted until 2026-06-15 04:29:05.768348303 +0000 UTC m=+218.331643211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wcxv4" (UID: "92eb6924-4d9f-4306-a45d-4a89cd012bff") : secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:03.869481 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.868577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:03.869481 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:03.868644 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:03.869481 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:03.868940 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 04:29:03.869481 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:03.869011 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:05.868989159 +0000 UTC m=+218.432284065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : secret "router-metrics-certs-default" not found Jun 15 04:29:03.869481 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:03.869437 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:05.869420613 +0000 UTC m=+218.432715535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : configmap references non-existent config key: service-ca.crt Jun 15 04:29:04.495130 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:04.495039 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" event={"ID":"950cdc0f-8e01-4894-86b6-152cd8573bd3","Type":"ContainerStarted","Data":"c3fb09057dc71a2e2e58496ac46d4f8f9fae6c3f59d8d37b97003a3b2663bac4"} Jun 15 04:29:04.509936 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:04.509889 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-nps7s" podStartSLOduration=1.1610286969999999 podStartE2EDuration="2.509874985s" totalImagesPullingTime="1.348846288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:04.509041084 +0000 UTC m=+217.072336010" watchObservedRunningTime="2026-06-15 04:29:04.509874985 +0000 UTC m=+217.073169953" Jun 15 04:29:04.510106 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:04.510085 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-n2j57" podStartSLOduration=2.510079369 podStartE2EDuration="2.510079369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:03.496615137 +0000 UTC m=+216.059910062" watchObservedRunningTime="2026-06-15 04:29:04.510079369 +0000 UTC m=+217.073374293" Jun 15 04:29:05.785305 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:05.785272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:05.785665 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:05.785433 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:05.785665 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:05.785514 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls podName:92eb6924-4d9f-4306-a45d-4a89cd012bff nodeName:}" failed. No retries permitted until 2026-06-15 04:29:09.785493896 +0000 UTC m=+222.348788803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wcxv4" (UID: "92eb6924-4d9f-4306-a45d-4a89cd012bff") : secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:05.885817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:05.885720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:05.885817 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:05.885785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:05.886013 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:05.885909 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:09.885886713 +0000 UTC m=+222.449181633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : configmap references non-existent config key: service-ca.crt Jun 15 04:29:05.886013 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:05.885909 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 04:29:05.886013 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:05.885956 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:09.885947167 +0000 UTC m=+222.449242069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : secret "router-metrics-certs-default" not found Jun 15 04:29:06.468595 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.468565 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jp246"] Jun 15 04:29:06.470529 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.470503 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.473076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.473049 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 04:29:06.473197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.473106 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 04:29:06.473271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.473235 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2v5qj\"" Jun 15 04:29:06.480376 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.480354 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jp246"] Jun 15 04:29:06.504642 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.504608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" event={"ID":"a9b0df88-f0d9-4a95-8159-728a6e4f8633","Type":"ContainerStarted","Data":"68c734253f541b61cf590c7adece39871851f5616a052cb2a726852c010b2783"} Jun 15 04:29:06.506457 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.506426 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" event={"ID":"03dc7bbd-02d6-48b2-afcd-9ec86140d085","Type":"ContainerStarted","Data":"a731c906dacb16203580c02d26c8ad352a2a8be6289fe83619f24b216cce9321"} Jun 15 04:29:06.507965 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.507948 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/0.log" Jun 15 04:29:06.508072 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.507978 2554 generic.go:356] "Generic (PLEG): container finished" podID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" containerID="722ac23821bc480719903b1aa8956e402d6fbfe34b2a379840e33fca43d49cea" exitCode=255 Jun 15 04:29:06.508072 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.508000 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" event={"ID":"fde07d4b-ea1f-4221-b9d8-92775b213ac1","Type":"ContainerDied","Data":"722ac23821bc480719903b1aa8956e402d6fbfe34b2a379840e33fca43d49cea"} Jun 15 04:29:06.508211 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.508196 2554 scope.go:117] "RemoveContainer" containerID="722ac23821bc480719903b1aa8956e402d6fbfe34b2a379840e33fca43d49cea" Jun 15 04:29:06.520742 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.520697 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" podStartSLOduration=1.479582516 podStartE2EDuration="4.520653715s" totalImagesPullingTime="3.041071199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:06.520400571 +0000 UTC m=+219.083695519" watchObservedRunningTime="2026-06-15 04:29:06.520653715 +0000 UTC m=+219.083948638" Jun 15 04:29:06.556959 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.556914 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" podStartSLOduration=1.621886084 podStartE2EDuration="4.556899099s" totalImagesPullingTime="2.935013015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:06.556197497 +0000 UTC m=+219.119492422" watchObservedRunningTime="2026-06-15 04:29:06.556899099 +0000 UTC m=+219.120194020" Jun 15 04:29:06.590928 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.590894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.591038 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.591007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf9d5088-0306-46f2-a1db-023aea808360-crio-socket\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.591103 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.591041 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccsf\" (UniqueName: \"kubernetes.io/projected/bf9d5088-0306-46f2-a1db-023aea808360-kube-api-access-mccsf\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.591624 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.591193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.591624 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.591246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d5088-0306-46f2-a1db-023aea808360-data-volume\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.692531 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.692495 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.692701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.692542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf9d5088-0306-46f2-a1db-023aea808360-crio-socket\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.692701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.692569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccsf\" (UniqueName: \"kubernetes.io/projected/bf9d5088-0306-46f2-a1db-023aea808360-kube-api-access-mccsf\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.692701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.692631 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf9d5088-0306-46f2-a1db-023aea808360-crio-socket\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.692701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.692642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.692701 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:06.692655 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:06.692701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.692667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d5088-0306-46f2-a1db-023aea808360-data-volume\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.693029 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:06.692724 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:07.192706636 +0000 UTC m=+219.756001540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:06.693029 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:06.692724 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:06.693029 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:06.692829 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:07.19281055 +0000 UTC m=+219.756105456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : configmap "kube-rbac-proxy" not found Jun 15 04:29:06.693029 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.693011 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d5088-0306-46f2-a1db-023aea808360-data-volume\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:06.702639 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:06.702622 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccsf\" (UniqueName: \"kubernetes.io/projected/bf9d5088-0306-46f2-a1db-023aea808360-kube-api-access-mccsf\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:07.196476 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.196448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:07.196896 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.196500 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:07.196896 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:07.196571 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:07.196896 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:07.196591 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:07.196896 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:07.196644 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:08.196628703 +0000 UTC m=+220.759923605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : configmap "kube-rbac-proxy" not found Jun 15 04:29:07.196896 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:07.196660 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:08.196652464 +0000 UTC m=+220.759947367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:07.513330 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.513252 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/1.log" Jun 15 04:29:07.513665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.513649 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/0.log" Jun 15 04:29:07.513727 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.513698 2554 generic.go:356] "Generic (PLEG): container finished" podID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" containerID="7b2e9492d74fefaf22442779b1ba2cb66966b5b876eb1da16c9d7baccd9360c0" exitCode=255 Jun 15 04:29:07.513801 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.513783 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" event={"ID":"fde07d4b-ea1f-4221-b9d8-92775b213ac1","Type":"ContainerDied","Data":"7b2e9492d74fefaf22442779b1ba2cb66966b5b876eb1da16c9d7baccd9360c0"} Jun 15 04:29:07.513851 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.513830 2554 scope.go:117] "RemoveContainer" containerID="722ac23821bc480719903b1aa8956e402d6fbfe34b2a379840e33fca43d49cea" Jun 15 04:29:07.514082 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:07.514062 2554 scope.go:117] "RemoveContainer" containerID="7b2e9492d74fefaf22442779b1ba2cb66966b5b876eb1da16c9d7baccd9360c0" Jun 15 04:29:07.514266 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:07.514247 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-6xbp2_openshift-console-operator(fde07d4b-ea1f-4221-b9d8-92775b213ac1)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" podUID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" Jun 15 04:29:08.204482 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:08.204442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:08.204885 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:08.204539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:08.204885 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:08.204590 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:08.204885 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:08.204618 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:08.204885 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:08.204694 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:10.204655036 +0000 UTC m=+222.767949957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:08.204885 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:08.204711 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:10.204703465 +0000 UTC m=+222.767998368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : configmap "kube-rbac-proxy" not found Jun 15 04:29:08.518177 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:08.518101 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/1.log" Jun 15 04:29:08.518429 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:08.518415 2554 scope.go:117] "RemoveContainer" containerID="7b2e9492d74fefaf22442779b1ba2cb66966b5b876eb1da16c9d7baccd9360c0" Jun 15 04:29:08.518583 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:08.518565 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-6xbp2_openshift-console-operator(fde07d4b-ea1f-4221-b9d8-92775b213ac1)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" podUID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" Jun 15 04:29:09.251724 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:09.251693 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g78tp_7b8646a2-3ef1-4b10-b0a4-2d3285297793/dns-node-resolver/0.log" Jun 15 04:29:09.818059 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:09.818006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:09.818301 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:09.818166 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:09.818301 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:09.818251 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls podName:92eb6924-4d9f-4306-a45d-4a89cd012bff nodeName:}" failed. No retries permitted until 2026-06-15 04:29:17.818234292 +0000 UTC m=+230.381529197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wcxv4" (UID: "92eb6924-4d9f-4306-a45d-4a89cd012bff") : secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:09.919251 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:09.919209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:09.919251 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:09.919260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:09.919461 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:09.919351 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 04:29:09.919461 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:09.919390 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:17.919369075 +0000 UTC m=+230.482663979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : configmap references non-existent config key: service-ca.crt Jun 15 04:29:09.919538 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:09.919476 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:17.919464691 +0000 UTC m=+230.482759604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : secret "router-metrics-certs-default" not found Jun 15 04:29:10.221617 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:10.221513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:10.221800 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:10.221702 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:10.221800 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:10.221742 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:10.221800 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:10.221764 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:14.221749536 +0000 UTC m=+226.785044441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:10.221800 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:10.221797 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:10.221941 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:10.221839 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:14.221824658 +0000 UTC m=+226.785119559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : configmap "kube-rbac-proxy" not found Jun 15 04:29:10.272490 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:10.272460 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gm67b_4a16488f-7114-48dd-9354-5b4e5b1cf71e/node-ca/0.log" Jun 15 04:29:11.052107 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:11.052077 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clxdp_79938686-4627-46c4-83fd-13a544b741c2/serve-healthcheck-canary/0.log" Jun 15 04:29:12.445459 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:12.445360 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:12.445459 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:12.445422 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:12.445884 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:12.445776 2554 scope.go:117] "RemoveContainer" containerID="7b2e9492d74fefaf22442779b1ba2cb66966b5b876eb1da16c9d7baccd9360c0" Jun 15 04:29:12.445942 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:12.445922 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-6xbp2_openshift-console-operator(fde07d4b-ea1f-4221-b9d8-92775b213ac1)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" podUID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" Jun 15 04:29:14.252907 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:14.252857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:14.253301 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:14.252945 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:14.253301 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:14.252987 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:14.253301 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:14.253079 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:22.253059998 +0000 UTC m=+234.816354916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : configmap "kube-rbac-proxy" not found Jun 15 04:29:14.253301 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:14.253082 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:14.253301 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:14.253119 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls podName:bf9d5088-0306-46f2-a1db-023aea808360 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:22.253109381 +0000 UTC m=+234.816404283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jp246" (UID: "bf9d5088-0306-46f2-a1db-023aea808360") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:17.883940 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:17.883901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:17.884331 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:17.884053 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:17.884331 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:17.884118 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls podName:92eb6924-4d9f-4306-a45d-4a89cd012bff nodeName:}" failed. No retries permitted until 2026-06-15 04:29:33.884102889 +0000 UTC m=+246.447397791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wcxv4" (UID: "92eb6924-4d9f-4306-a45d-4a89cd012bff") : secret "cluster-monitoring-operator-tls" not found Jun 15 04:29:17.985201 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:17.985159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:17.985390 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:17.985302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:17.985480 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:17.985465 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle podName:d41d8e9b-3491-4d50-8451-424688a6347e nodeName:}" failed. No retries permitted until 2026-06-15 04:29:33.985444359 +0000 UTC m=+246.548739275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle") pod "router-default-74f46d5878-vxjd7" (UID: "d41d8e9b-3491-4d50-8451-424688a6347e") : configmap references non-existent config key: service-ca.crt Jun 15 04:29:17.987611 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:17.987587 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d41d8e9b-3491-4d50-8451-424688a6347e-metrics-certs\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:22.322538 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:22.322484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:22.323058 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:22.322578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:22.323111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:22.323058 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9d5088-0306-46f2-a1db-023aea808360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:22.324906 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:22.324882 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9d5088-0306-46f2-a1db-023aea808360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jp246\" (UID: \"bf9d5088-0306-46f2-a1db-023aea808360\") " pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:22.380198 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:22.380156 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jp246" Jun 15 04:29:22.508628 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:22.508596 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jp246"] Jun 15 04:29:22.511906 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:22.511880 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9d5088_0306_46f2_a1db_023aea808360.slice/crio-57d7173ed7167a6a8e6e2a8ce8f7f5b103a8975a15538a021886dbfc898b6c41 WatchSource:0}: Error finding container 57d7173ed7167a6a8e6e2a8ce8f7f5b103a8975a15538a021886dbfc898b6c41: Status 404 returned error can't find the container with id 57d7173ed7167a6a8e6e2a8ce8f7f5b103a8975a15538a021886dbfc898b6c41 Jun 15 04:29:22.558553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:22.558520 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jp246" event={"ID":"bf9d5088-0306-46f2-a1db-023aea808360","Type":"ContainerStarted","Data":"57d7173ed7167a6a8e6e2a8ce8f7f5b103a8975a15538a021886dbfc898b6c41"} Jun 15 04:29:26.574771 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:26.574730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jp246" event={"ID":"bf9d5088-0306-46f2-a1db-023aea808360","Type":"ContainerStarted","Data":"5072d8812ee9a7bd9153301dec93b1855e978480ebcaab0317123f7fdd0f5e09"} Jun 15 04:29:27.581559 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:27.581501 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jp246" event={"ID":"bf9d5088-0306-46f2-a1db-023aea808360","Type":"ContainerStarted","Data":"3c18d864df842cb1084bd50bee3b88c8fbb0c13eb6a8e3d9d860d324c06cf418"} Jun 15 04:29:27.824849 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:27.824815 2554 scope.go:117] "RemoveContainer" containerID="7b2e9492d74fefaf22442779b1ba2cb66966b5b876eb1da16c9d7baccd9360c0" Jun 15 04:29:28.586506 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:28.586475 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:29:28.586905 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:28.586853 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/1.log" Jun 15 04:29:28.586905 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:28.586888 2554 generic.go:356] "Generic (PLEG): container finished" podID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" containerID="ba2cbf19b631e02a4cdaf848a14333d67a838a7b80437cd62e769d53dfdcd3e9" exitCode=255 Jun 15 04:29:28.587004 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:28.586925 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" event={"ID":"fde07d4b-ea1f-4221-b9d8-92775b213ac1","Type":"ContainerDied","Data":"ba2cbf19b631e02a4cdaf848a14333d67a838a7b80437cd62e769d53dfdcd3e9"} Jun 15 04:29:28.587004 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:28.586969 2554 scope.go:117] "RemoveContainer" containerID="7b2e9492d74fefaf22442779b1ba2cb66966b5b876eb1da16c9d7baccd9360c0" Jun 15 04:29:28.587297 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:28.587277 2554 scope.go:117] "RemoveContainer" containerID="ba2cbf19b631e02a4cdaf848a14333d67a838a7b80437cd62e769d53dfdcd3e9" Jun 15 04:29:28.587497 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:28.587458 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-6xbp2_openshift-console-operator(fde07d4b-ea1f-4221-b9d8-92775b213ac1)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" podUID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" Jun 15 04:29:29.591887 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:29.591847 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jp246" event={"ID":"bf9d5088-0306-46f2-a1db-023aea808360","Type":"ContainerStarted","Data":"5868d0c6214daa2cd12e4773f91c976aef20c88d2d7a0c22147e23c3f9164e2f"} Jun 15 04:29:29.593313 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:29.593294 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:29:29.614273 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:29.611432 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jp246" podStartSLOduration=17.628653642 podStartE2EDuration="23.611412142s" totalImagesPullingTime="5.9827585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:29:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:29.609093773 +0000 UTC m=+242.172388714" watchObservedRunningTime="2026-06-15 04:29:29.611412142 +0000 UTC m=+242.174707068" Jun 15 04:29:30.880368 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.880329 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-667c798b7d-jjw75"] Jun 15 04:29:30.883418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.883401 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.885905 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.885879 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 04:29:30.886058 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.886036 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 04:29:30.886136 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.886037 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 04:29:30.887190 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.887174 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8jjd9\"" Jun 15 04:29:30.891454 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.891375 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 04:29:30.895458 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.895436 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-667c798b7d-jjw75"] Jun 15 04:29:30.994862 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.994824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e51c63b2-cb96-4905-92ce-90f45b848cdd-trusted-ca\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.994862 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.994865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwb9m\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-kube-api-access-jwb9m\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.995111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.994886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-bound-sa-token\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.995111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.994986 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e51c63b2-cb96-4905-92ce-90f45b848cdd-registry-certificates\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.995111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.995036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e51c63b2-cb96-4905-92ce-90f45b848cdd-ca-trust-extracted\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.995111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.995062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-registry-tls\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.995111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.995083 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e51c63b2-cb96-4905-92ce-90f45b848cdd-image-registry-private-configuration\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:30.995111 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:30.995106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e51c63b2-cb96-4905-92ce-90f45b848cdd-installation-pull-secrets\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.095657 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e51c63b2-cb96-4905-92ce-90f45b848cdd-registry-certificates\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.095854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e51c63b2-cb96-4905-92ce-90f45b848cdd-ca-trust-extracted\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.095854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095748 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-registry-tls\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.095854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095777 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e51c63b2-cb96-4905-92ce-90f45b848cdd-image-registry-private-configuration\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.095854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e51c63b2-cb96-4905-92ce-90f45b848cdd-installation-pull-secrets\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.095854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e51c63b2-cb96-4905-92ce-90f45b848cdd-trusted-ca\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.096085 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwb9m\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-kube-api-access-jwb9m\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.096085 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.095988 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-bound-sa-token\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.096231 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.096206 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e51c63b2-cb96-4905-92ce-90f45b848cdd-ca-trust-extracted\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.096599 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.096574 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e51c63b2-cb96-4905-92ce-90f45b848cdd-registry-certificates\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.096958 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.096935 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e51c63b2-cb96-4905-92ce-90f45b848cdd-trusted-ca\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.098330 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.098302 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e51c63b2-cb96-4905-92ce-90f45b848cdd-image-registry-private-configuration\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.098451 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.098351 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e51c63b2-cb96-4905-92ce-90f45b848cdd-installation-pull-secrets\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.098513 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.098489 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-registry-tls\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.103188 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.103163 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-bound-sa-token\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.103758 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.103734 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwb9m\" (UniqueName: \"kubernetes.io/projected/e51c63b2-cb96-4905-92ce-90f45b848cdd-kube-api-access-jwb9m\") pod \"image-registry-667c798b7d-jjw75\" (UID: \"e51c63b2-cb96-4905-92ce-90f45b848cdd\") " pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.194012 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.193928 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.319530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.319505 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-667c798b7d-jjw75"] Jun 15 04:29:31.321963 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:31.321938 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51c63b2_cb96_4905_92ce_90f45b848cdd.slice/crio-0f584822fbb72e07763672096a20e445d0c7d67b1765e231a62af8000b023873 WatchSource:0}: Error finding container 0f584822fbb72e07763672096a20e445d0c7d67b1765e231a62af8000b023873: Status 404 returned error can't find the container with id 0f584822fbb72e07763672096a20e445d0c7d67b1765e231a62af8000b023873 Jun 15 04:29:31.600307 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.600266 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" event={"ID":"e51c63b2-cb96-4905-92ce-90f45b848cdd","Type":"ContainerStarted","Data":"c1fd2109219c2fa1fd286132909866cacb6dd7a1baa32c93ecbe81c0e9fe7a13"} Jun 15 04:29:31.600496 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.600332 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" event={"ID":"e51c63b2-cb96-4905-92ce-90f45b848cdd","Type":"ContainerStarted","Data":"0f584822fbb72e07763672096a20e445d0c7d67b1765e231a62af8000b023873"} Jun 15 04:29:31.600496 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.600385 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:29:31.619875 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:31.619817 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podStartSLOduration=1.61980281 podStartE2EDuration="1.61980281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:31.618587919 +0000 UTC m=+244.181882866" watchObservedRunningTime="2026-06-15 04:29:31.61980281 +0000 UTC m=+244.183097734" Jun 15 04:29:32.445921 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:32.445887 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:32.446318 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:32.445937 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:32.446318 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:32.446227 2554 scope.go:117] "RemoveContainer" containerID="ba2cbf19b631e02a4cdaf848a14333d67a838a7b80437cd62e769d53dfdcd3e9" Jun 15 04:29:32.446391 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:32.446370 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-6xbp2_openshift-console-operator(fde07d4b-ea1f-4221-b9d8-92775b213ac1)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" podUID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" Jun 15 04:29:33.918661 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:33.918604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:33.920998 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:33.920976 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92eb6924-4d9f-4306-a45d-4a89cd012bff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wcxv4\" (UID: \"92eb6924-4d9f-4306-a45d-4a89cd012bff\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:33.933217 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:33.933188 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wrjkw\"" Jun 15 04:29:33.941162 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:33.941137 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" Jun 15 04:29:34.019401 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.019357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:34.019971 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.019946 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d41d8e9b-3491-4d50-8451-424688a6347e-service-ca-bundle\") pod \"router-default-74f46d5878-vxjd7\" (UID: \"d41d8e9b-3491-4d50-8451-424688a6347e\") " pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:34.041583 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.041556 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5gzzh\"" Jun 15 04:29:34.049659 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.049631 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:34.066574 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.066548 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4"] Jun 15 04:29:34.068721 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:34.068668 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92eb6924_4d9f_4306_a45d_4a89cd012bff.slice/crio-95ff619428cf1239ff96b354ea0c443e88f30370c656ffa9ae076708954c8b0c WatchSource:0}: Error finding container 95ff619428cf1239ff96b354ea0c443e88f30370c656ffa9ae076708954c8b0c: Status 404 returned error can't find the container with id 95ff619428cf1239ff96b354ea0c443e88f30370c656ffa9ae076708954c8b0c Jun 15 04:29:34.176558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.176532 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74f46d5878-vxjd7"] Jun 15 04:29:34.178842 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:34.178817 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41d8e9b_3491_4d50_8451_424688a6347e.slice/crio-c58c5c1a99f28d17ec64ae9881a3da6e9efc116bae1196b14d12ad74b32bd5b1 WatchSource:0}: Error finding container c58c5c1a99f28d17ec64ae9881a3da6e9efc116bae1196b14d12ad74b32bd5b1: Status 404 returned error can't find the container with id c58c5c1a99f28d17ec64ae9881a3da6e9efc116bae1196b14d12ad74b32bd5b1 Jun 15 04:29:34.613140 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.613101 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74f46d5878-vxjd7" event={"ID":"d41d8e9b-3491-4d50-8451-424688a6347e","Type":"ContainerStarted","Data":"cd8215c70100bfff5c4d6969e112dc91d55bf3a9140b8afad8e6fb3ba43510b4"} Jun 15 04:29:34.613334 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.613155 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74f46d5878-vxjd7" event={"ID":"d41d8e9b-3491-4d50-8451-424688a6347e","Type":"ContainerStarted","Data":"c58c5c1a99f28d17ec64ae9881a3da6e9efc116bae1196b14d12ad74b32bd5b1"} Jun 15 04:29:34.614206 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.614180 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" event={"ID":"92eb6924-4d9f-4306-a45d-4a89cd012bff","Type":"ContainerStarted","Data":"95ff619428cf1239ff96b354ea0c443e88f30370c656ffa9ae076708954c8b0c"} Jun 15 04:29:34.633711 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:34.633646 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74f46d5878-vxjd7" podStartSLOduration=32.633632358 podStartE2EDuration="32.633632358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:34.632251809 +0000 UTC m=+247.195546754" watchObservedRunningTime="2026-06-15 04:29:34.633632358 +0000 UTC m=+247.196927283" Jun 15 04:29:35.049873 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:35.049837 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:35.052603 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:35.052580 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:35.617411 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:35.617377 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:35.618611 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:35.618570 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74f46d5878-vxjd7" Jun 15 04:29:36.621552 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:36.621511 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" event={"ID":"92eb6924-4d9f-4306-a45d-4a89cd012bff","Type":"ContainerStarted","Data":"dd76f12bdb7f955819f819143c3eacf93ab7aed06f5d8c52a42de8a00c2f0708"} Jun 15 04:29:36.637421 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:36.637373 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wcxv4" podStartSLOduration=33.087767723 podStartE2EDuration="34.637357201s" totalImagesPullingTime="1.549589478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:36.636693593 +0000 UTC m=+249.199988520" watchObservedRunningTime="2026-06-15 04:29:36.637357201 +0000 UTC m=+249.200652124" Jun 15 04:29:38.128760 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.128723 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l"] Jun 15 04:29:38.133434 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.133417 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.136938 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.136909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 04:29:38.137068 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.136909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5f2zk\"" Jun 15 04:29:38.137068 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.136912 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 04:29:38.137068 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.136923 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 04:29:38.139800 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.139776 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l"] Jun 15 04:29:38.253605 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.253566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2e96491-79ed-4319-a199-04c619eabef5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.253605 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.253607 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkqz\" (UniqueName: \"kubernetes.io/projected/c2e96491-79ed-4319-a199-04c619eabef5-kube-api-access-ggkqz\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.253867 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.253629 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e96491-79ed-4319-a199-04c619eabef5-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.253867 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.253706 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2e96491-79ed-4319-a199-04c619eabef5-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.354472 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.354441 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e96491-79ed-4319-a199-04c619eabef5-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.354634 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.354482 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2e96491-79ed-4319-a199-04c619eabef5-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.354634 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.354534 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2e96491-79ed-4319-a199-04c619eabef5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.354634 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.354555 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkqz\" (UniqueName: \"kubernetes.io/projected/c2e96491-79ed-4319-a199-04c619eabef5-kube-api-access-ggkqz\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.355223 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.355189 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2e96491-79ed-4319-a199-04c619eabef5-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.356952 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.356920 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2e96491-79ed-4319-a199-04c619eabef5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.357049 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.356980 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2e96491-79ed-4319-a199-04c619eabef5-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.362109 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.362075 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkqz\" (UniqueName: \"kubernetes.io/projected/c2e96491-79ed-4319-a199-04c619eabef5-kube-api-access-ggkqz\") pod \"prometheus-operator-864fcfc6f9-sj22l\" (UID: \"c2e96491-79ed-4319-a199-04c619eabef5\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.443266 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.443191 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" Jun 15 04:29:38.566099 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.565947 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l"] Jun 15 04:29:38.568601 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:38.568572 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e96491_79ed_4319_a199_04c619eabef5.slice/crio-6f9e10f13215c8dddfe8c7d3885d5626807dd13cdedd8b3b5013e192a01b090c WatchSource:0}: Error finding container 6f9e10f13215c8dddfe8c7d3885d5626807dd13cdedd8b3b5013e192a01b090c: Status 404 returned error can't find the container with id 6f9e10f13215c8dddfe8c7d3885d5626807dd13cdedd8b3b5013e192a01b090c Jun 15 04:29:38.629243 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:38.629206 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" event={"ID":"c2e96491-79ed-4319-a199-04c619eabef5","Type":"ContainerStarted","Data":"6f9e10f13215c8dddfe8c7d3885d5626807dd13cdedd8b3b5013e192a01b090c"} Jun 15 04:29:39.663864 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:39.663782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:29:39.666029 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:39.666005 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f-metrics-certs\") pod \"network-metrics-daemon-tqgb2\" (UID: \"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f\") " pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:29:39.727919 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:39.727890 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8s6z2\"" Jun 15 04:29:39.736034 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:39.736007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tqgb2" Jun 15 04:29:39.867926 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:39.867860 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tqgb2"] Jun 15 04:29:40.638007 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:40.637973 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" event={"ID":"c2e96491-79ed-4319-a199-04c619eabef5","Type":"ContainerStarted","Data":"cfc22ecd3aa68095ba98b90930941d553fd3abfe9525dc6b45c19a36f3ae13bb"} Jun 15 04:29:40.638186 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:40.638041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" event={"ID":"c2e96491-79ed-4319-a199-04c619eabef5","Type":"ContainerStarted","Data":"8e33791f42fe0edc2e42a66b470d95bd59555aa95f75c4ee91b61301d22ddf40"} Jun 15 04:29:40.639217 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:40.639193 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tqgb2" event={"ID":"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f","Type":"ContainerStarted","Data":"adfec364333d42da905f78744fc8bb97f72ceb5bf4a4fcf1b9c3fff95fecef69"} Jun 15 04:29:40.654965 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:40.654916 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-sj22l" podStartSLOduration=1.311550271 podStartE2EDuration="2.654899142s" totalImagesPullingTime="1.343348871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:40.65266789 +0000 UTC m=+253.215962836" watchObservedRunningTime="2026-06-15 04:29:40.654899142 +0000 UTC m=+253.218194066" Jun 15 04:29:41.644123 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:41.644084 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tqgb2" event={"ID":"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f","Type":"ContainerStarted","Data":"10948b89c386d608ab3dee55adbd804d41cb213aef7f19af5d74035139c68651"} Jun 15 04:29:41.644523 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:41.644151 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tqgb2" event={"ID":"8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f","Type":"ContainerStarted","Data":"89a302c59827e1cdde794c48fb0535992bda27d7f0cf0a4f4c975d318243f09f"} Jun 15 04:29:41.659050 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:41.658986 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tqgb2" podStartSLOduration=253.716436267 podStartE2EDuration="4m14.658969122s" totalImagesPullingTime="942.532855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:41.658175997 +0000 UTC m=+254.221470941" watchObservedRunningTime="2026-06-15 04:29:41.658969122 +0000 UTC m=+254.222264094" Jun 15 04:29:42.480168 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.480131 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ksgfw"] Jun 15 04:29:42.482067 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.482049 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.484922 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.484897 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 04:29:42.485029 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.484988 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 04:29:42.485106 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.485090 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 04:29:42.485222 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.485205 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z6bg8\"" Jun 15 04:29:42.487908 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.487887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-root\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.487919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-sys\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.487948 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-tls\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488101 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.488029 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488101 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.488075 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-textfile\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488187 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.488099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75a973d2-a8f9-42b2-a6dd-35c7a4965842-metrics-client-ca\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488187 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.488128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskbl\" (UniqueName: \"kubernetes.io/projected/75a973d2-a8f9-42b2-a6dd-35c7a4965842-kube-api-access-jskbl\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.488187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-wtmp\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.488263 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.488214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589048 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-tls\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589048 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589052 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589240 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-textfile\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589240 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:42.589156 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 04:29:42.589240 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589197 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75a973d2-a8f9-42b2-a6dd-35c7a4965842-metrics-client-ca\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589240 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:42.589232 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-tls podName:75a973d2-a8f9-42b2-a6dd-35c7a4965842 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:43.089209589 +0000 UTC m=+255.652504512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-tls") pod "node-exporter-ksgfw" (UID: "75a973d2-a8f9-42b2-a6dd-35c7a4965842") : secret "node-exporter-tls" not found Jun 15 04:29:42.589402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jskbl\" (UniqueName: \"kubernetes.io/projected/75a973d2-a8f9-42b2-a6dd-35c7a4965842-kube-api-access-jskbl\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-wtmp\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589337 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589366 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-textfile\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589402 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-root\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589627 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589441 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-sys\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589627 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589496 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-wtmp\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589627 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589517 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-root\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589627 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589548 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75a973d2-a8f9-42b2-a6dd-35c7a4965842-sys\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589883 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589861 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.589954 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.589861 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75a973d2-a8f9-42b2-a6dd-35c7a4965842-metrics-client-ca\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.591488 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.591469 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:42.598558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:42.598536 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskbl\" (UniqueName: \"kubernetes.io/projected/75a973d2-a8f9-42b2-a6dd-35c7a4965842-kube-api-access-jskbl\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:43.096207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.096164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-tls\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:43.098555 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.098530 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75a973d2-a8f9-42b2-a6dd-35c7a4965842-node-exporter-tls\") pod \"node-exporter-ksgfw\" (UID: \"75a973d2-a8f9-42b2-a6dd-35c7a4965842\") " pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:43.391562 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.391472 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ksgfw" Jun 15 04:29:43.401859 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:43.401833 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a973d2_a8f9_42b2_a6dd_35c7a4965842.slice/crio-d95241b2d015ea7dd62e61443b3cca5a09cafb7822579e97d1dc462e9cbc9c58 WatchSource:0}: Error finding container d95241b2d015ea7dd62e61443b3cca5a09cafb7822579e97d1dc462e9cbc9c58: Status 404 returned error can't find the container with id d95241b2d015ea7dd62e61443b3cca5a09cafb7822579e97d1dc462e9cbc9c58 Jun 15 04:29:43.519823 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.519787 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:29:43.522848 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.522829 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.525416 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525393 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 04:29:43.525553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525453 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 04:29:43.525961 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525655 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 04:29:43.525961 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525729 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 04:29:43.525961 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525662 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 04:29:43.525961 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525813 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8hxch\"" Jun 15 04:29:43.525961 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525865 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 04:29:43.525961 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.525939 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 04:29:43.526849 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.526742 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 04:29:43.526849 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.526779 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 04:29:43.535867 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.535843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:29:43.600891 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.600858 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-out\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601043 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.600895 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601043 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.600916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601043 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.600934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601043 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.600966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601043 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601025 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601075 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601098 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601116 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhp9s\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-kube-api-access-zhp9s\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601178 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-web-config\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.601378 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.601227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.655067 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.654975 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksgfw" event={"ID":"75a973d2-a8f9-42b2-a6dd-35c7a4965842","Type":"ContainerStarted","Data":"d95241b2d015ea7dd62e61443b3cca5a09cafb7822579e97d1dc462e9cbc9c58"} Jun 15 04:29:43.702503 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702464 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702517 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-web-config\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-out\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702613 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702647 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.702738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.703181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.703181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.703181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.702815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhp9s\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-kube-api-access-zhp9s\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.703181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.703148 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.703366 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:43.703298 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle podName:efc08f6d-3156-4e73-9815-a5e19775d6ca nodeName:}" failed. No retries permitted until 2026-06-15 04:29:44.20327677 +0000 UTC m=+256.766571674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca") : configmap references non-existent config key: ca-bundle.crt Jun 15 04:29:43.704164 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.703998 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.706216 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.705940 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-web-config\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.706216 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.705971 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.706216 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:43.706073 2554 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 15 04:29:43.706216 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:43.706132 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls podName:efc08f6d-3156-4e73-9815-a5e19775d6ca nodeName:}" failed. No retries permitted until 2026-06-15 04:29:44.206113947 +0000 UTC m=+256.769408865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca") : secret "alertmanager-main-tls" not found Jun 15 04:29:43.706495 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.706337 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.706890 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.706822 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.706890 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.706884 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.707029 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.706892 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.707029 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.707014 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.708062 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.708037 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-out\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:43.715456 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:43.715432 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhp9s\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-kube-api-access-zhp9s\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:44.207839 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:44.207798 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:44.208419 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:44.207863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:44.208419 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:44.207968 2554 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 15 04:29:44.208419 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:44.208039 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls podName:efc08f6d-3156-4e73-9815-a5e19775d6ca nodeName:}" failed. No retries permitted until 2026-06-15 04:29:45.208021571 +0000 UTC m=+257.771316475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca") : secret "alertmanager-main-tls" not found Jun 15 04:29:44.208778 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:44.208758 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:44.660045 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:44.660009 2554 generic.go:356] "Generic (PLEG): container finished" podID="75a973d2-a8f9-42b2-a6dd-35c7a4965842" containerID="ff428d9eac7d3411669e278e6cf0619bf47e7a9b1215dca59c45c3d8111d647e" exitCode=0 Jun 15 04:29:44.660222 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:44.660100 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksgfw" event={"ID":"75a973d2-a8f9-42b2-a6dd-35c7a4965842","Type":"ContainerDied","Data":"ff428d9eac7d3411669e278e6cf0619bf47e7a9b1215dca59c45c3d8111d647e"} Jun 15 04:29:45.215700 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.215633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:45.218117 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.218093 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:45.334313 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.334276 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:29:45.467802 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.467729 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:29:45.467906 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:45.467804 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc08f6d_3156_4e73_9815_a5e19775d6ca.slice/crio-957da2b7b6dadb88c3f747525b00e5da0f8b0c0a4dd269183ae65784b0a4bdd6 WatchSource:0}: Error finding container 957da2b7b6dadb88c3f747525b00e5da0f8b0c0a4dd269183ae65784b0a4bdd6: Status 404 returned error can't find the container with id 957da2b7b6dadb88c3f747525b00e5da0f8b0c0a4dd269183ae65784b0a4bdd6 Jun 15 04:29:45.668306 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.668273 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksgfw" event={"ID":"75a973d2-a8f9-42b2-a6dd-35c7a4965842","Type":"ContainerStarted","Data":"c8b0f072f9ae91fc8a9b19dcaa91ab1fa5163a2f3188ca05a6f23c8b68cc9375"} Jun 15 04:29:45.668486 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.668328 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksgfw" event={"ID":"75a973d2-a8f9-42b2-a6dd-35c7a4965842","Type":"ContainerStarted","Data":"856a5f51fa2651eb2031a593df84c35a2d78e7052831fcd93098ec3ec4e3a4d9"} Jun 15 04:29:45.669376 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.669354 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerStarted","Data":"957da2b7b6dadb88c3f747525b00e5da0f8b0c0a4dd269183ae65784b0a4bdd6"} Jun 15 04:29:45.686809 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:45.686759 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ksgfw" podStartSLOduration=2.811077803 podStartE2EDuration="3.686743418s" totalImagesPullingTime="807.295812ms" totalInitContainerRuntime="68.369803ms" isStatefulPod=true podCreationTimestamp="2026-06-15 04:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:45.686019944 +0000 UTC m=+258.249314878" watchObservedRunningTime="2026-06-15 04:29:45.686743418 +0000 UTC m=+258.250038343" Jun 15 04:29:46.674147 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:46.674053 2554 generic.go:356] "Generic (PLEG): container finished" podID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerID="d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d" exitCode=0 Jun 15 04:29:46.674600 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:46.674138 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d"} Jun 15 04:29:46.824159 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:46.824131 2554 scope.go:117] "RemoveContainer" containerID="ba2cbf19b631e02a4cdaf848a14333d67a838a7b80437cd62e769d53dfdcd3e9" Jun 15 04:29:46.824319 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:29:46.824259 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-6xbp2_openshift-console-operator(fde07d4b-ea1f-4221-b9d8-92775b213ac1)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" podUID="fde07d4b-ea1f-4221-b9d8-92775b213ac1" Jun 15 04:29:48.645360 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.645257 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:29:48.649124 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.649091 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.652284 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.652225 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 04:29:48.653136 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.653108 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 04:29:48.653327 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.653306 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 04:29:48.653458 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.653448 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 04:29:48.653702 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.653657 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 04:29:48.653831 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.653817 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 04:29:48.654131 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.654114 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 04:29:48.654298 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.654284 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v97x5\"" Jun 15 04:29:48.654438 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.654424 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7t4n5bemtdgip\"" Jun 15 04:29:48.654721 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.654706 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 04:29:48.654899 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.654881 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 04:29:48.655085 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.655068 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 04:29:48.655575 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.655555 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 04:29:48.655778 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.655760 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 04:29:48.655864 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.655821 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 04:29:48.656014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.655994 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 04:29:48.669071 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.666844 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:29:48.671416 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.670211 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 04:29:48.692239 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.692194 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerStarted","Data":"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c"} Jun 15 04:29:48.692397 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.692287 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerStarted","Data":"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e"} Jun 15 04:29:48.692397 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.692325 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerStarted","Data":"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26"} Jun 15 04:29:48.692397 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.692350 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerStarted","Data":"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f"} Jun 15 04:29:48.692397 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.692377 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerStarted","Data":"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01"} Jun 15 04:29:48.745665 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745624 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.745904 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.745904 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745753 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.745904 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745785 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.745904 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.745904 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.745904 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.745929 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746086 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746113 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzfs4\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-kube-api-access-vzfs4\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746650 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746650 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746650 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746348 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.746650 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.746376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847088 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847088 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847093 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847422 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847555 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzfs4\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-kube-api-access-vzfs4\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847613 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847662 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847755 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847824 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.847876 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.848271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.848271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.848271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.847975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.848271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.848005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.851706 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.848656 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.851706 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.850030 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.851706 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.850364 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.851706 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.850929 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.851706 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.851548 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.853736 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.852760 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.853736 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.853241 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.853736 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.853594 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.853957 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.853782 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.854020 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.853951 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.855277 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.854833 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.855277 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.854848 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.855277 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.855137 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.855495 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.855289 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.856265 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.856240 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.856593 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.856572 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.856784 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.856764 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.857586 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.857536 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.857709 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.857585 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.858079 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.858056 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzfs4\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-kube-api-access-vzfs4\") pod \"prometheus-k8s-0\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:48.971553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:48.971518 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:29:49.129521 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:49.129494 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:29:49.131499 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:29:49.131470 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d0bbeb_5bcb_4e5b_87f6_003d498717ed.slice/crio-45c08419ad07afddc80b8011bb0f02d7198724da01135a1600e4c45a76294647 WatchSource:0}: Error finding container 45c08419ad07afddc80b8011bb0f02d7198724da01135a1600e4c45a76294647: Status 404 returned error can't find the container with id 45c08419ad07afddc80b8011bb0f02d7198724da01135a1600e4c45a76294647 Jun 15 04:29:49.699584 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:49.699545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerStarted","Data":"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c"} Jun 15 04:29:49.701019 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:49.700993 2554 generic.go:356] "Generic (PLEG): container finished" podID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerID="1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538" exitCode=0 Jun 15 04:29:49.701138 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:49.701039 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538"} Jun 15 04:29:49.701138 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:49.701091 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerStarted","Data":"45c08419ad07afddc80b8011bb0f02d7198724da01135a1600e4c45a76294647"} Jun 15 04:29:49.725127 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:49.725079 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.820666749 podStartE2EDuration="6.725062334s" totalImagesPullingTime="2.886306831s" totalInitContainerRuntime="18.088754ms" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:49.722620366 +0000 UTC m=+262.285915289" watchObservedRunningTime="2026-06-15 04:29:49.725062334 +0000 UTC m=+262.288357259" Jun 15 04:29:51.199810 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:51.199768 2554 patch_prober.go:28] interesting pod/image-registry-667c798b7d-jjw75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:29:51.200207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:51.199842 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:29:52.609918 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:52.609881 2554 patch_prober.go:28] interesting pod/image-registry-667c798b7d-jjw75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:29:52.610292 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:52.609954 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:29:52.717563 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:52.717528 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerStarted","Data":"6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29"} Jun 15 04:29:53.726346 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:53.726299 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerStarted","Data":"33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345"} Jun 15 04:29:55.738053 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:55.738010 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerStarted","Data":"9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1"} Jun 15 04:29:55.738499 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:55.738127 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerStarted","Data":"09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf"} Jun 15 04:29:55.738499 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:55.738168 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerStarted","Data":"7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1"} Jun 15 04:29:55.738499 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:55.738213 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerStarted","Data":"5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c"} Jun 15 04:29:55.765062 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:55.764996 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.761305973 podStartE2EDuration="7.764972519s" totalImagesPullingTime="4.985408755s" totalInitContainerRuntime="18.257791ms" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:55.763400816 +0000 UTC m=+268.326695805" watchObservedRunningTime="2026-06-15 04:29:55.764972519 +0000 UTC m=+268.328267444" Jun 15 04:29:57.826321 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:57.826296 2554 scope.go:117] "RemoveContainer" containerID="ba2cbf19b631e02a4cdaf848a14333d67a838a7b80437cd62e769d53dfdcd3e9" Jun 15 04:29:58.751261 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:58.751229 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:29:58.751435 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:58.751304 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" event={"ID":"fde07d4b-ea1f-4221-b9d8-92775b213ac1","Type":"ContainerStarted","Data":"8891df8f11129e923332139c7082cb4e98cd8ed32ebcaa175103e9b1ed6d9e84"} Jun 15 04:29:58.751712 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:58.751649 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:58.756429 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:58.756403 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" Jun 15 04:29:58.775657 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:58.772486 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-6xbp2" podStartSLOduration=53.756240869 podStartE2EDuration="56.772465833s" totalImagesPullingTime="3.016224964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:58.770888547 +0000 UTC m=+271.334183480" watchObservedRunningTime="2026-06-15 04:29:58.772465833 +0000 UTC m=+271.335760758" Jun 15 04:29:58.972694 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:29:58.972643 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:30:01.198158 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:01.198124 2554 patch_prober.go:28] interesting pod/image-registry-667c798b7d-jjw75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:30:01.198738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:01.198182 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:30:02.610074 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:02.610037 2554 patch_prober.go:28] interesting pod/image-registry-667c798b7d-jjw75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:30:02.610497 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:02.610120 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:30:08.336443 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:30:08.336396 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fhkm2" podUID="7cd4563d-c0e0-463e-b183-b74a32d1ef66" Jun 15 04:30:08.792851 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:08.792818 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhkm2" Jun 15 04:30:11.198066 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.198035 2554 patch_prober.go:28] interesting pod/image-registry-667c798b7d-jjw75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:30:11.198504 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.198083 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:30:11.198504 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.198120 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:30:11.198605 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.198548 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"c1fd2109219c2fa1fd286132909866cacb6dd7a1baa32c93ecbe81c0e9fe7a13"} pod="openshift-image-registry/image-registry-667c798b7d-jjw75" containerMessage="Container registry failed liveness probe, will be restarted" Jun 15 04:30:11.202068 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.202038 2554 patch_prober.go:28] interesting pod/image-registry-667c798b7d-jjw75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:30:11.202198 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.202090 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:30:11.804258 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.804225 2554 generic.go:356] "Generic (PLEG): container finished" podID="03dc7bbd-02d6-48b2-afcd-9ec86140d085" containerID="a731c906dacb16203580c02d26c8ad352a2a8be6289fe83619f24b216cce9321" exitCode=0 Jun 15 04:30:11.804258 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.804263 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" event={"ID":"03dc7bbd-02d6-48b2-afcd-9ec86140d085","Type":"ContainerDied","Data":"a731c906dacb16203580c02d26c8ad352a2a8be6289fe83619f24b216cce9321"} Jun 15 04:30:11.804563 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:11.804551 2554 scope.go:117] "RemoveContainer" containerID="a731c906dacb16203580c02d26c8ad352a2a8be6289fe83619f24b216cce9321" Jun 15 04:30:12.266614 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:12.266578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:30:12.269014 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:12.268987 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd4563d-c0e0-463e-b183-b74a32d1ef66-metrics-tls\") pod \"dns-default-fhkm2\" (UID: \"7cd4563d-c0e0-463e-b183-b74a32d1ef66\") " pod="openshift-dns/dns-default-fhkm2" Jun 15 04:30:12.396103 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:12.396014 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zvtcp\"" Jun 15 04:30:12.404078 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:12.404046 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhkm2" Jun 15 04:30:12.543171 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:12.543147 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhkm2"] Jun 15 04:30:12.545598 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:30:12.545569 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd4563d_c0e0_463e_b183_b74a32d1ef66.slice/crio-e408c20885ff82e040127c329c628fa7943a06e933ef81b5781d2713022da1ef WatchSource:0}: Error finding container e408c20885ff82e040127c329c628fa7943a06e933ef81b5781d2713022da1ef: Status 404 returned error can't find the container with id e408c20885ff82e040127c329c628fa7943a06e933ef81b5781d2713022da1ef Jun 15 04:30:12.809591 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:12.809554 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhkm2" event={"ID":"7cd4563d-c0e0-463e-b183-b74a32d1ef66","Type":"ContainerStarted","Data":"e408c20885ff82e040127c329c628fa7943a06e933ef81b5781d2713022da1ef"} Jun 15 04:30:12.811276 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:12.811254 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-22r4f" event={"ID":"03dc7bbd-02d6-48b2-afcd-9ec86140d085","Type":"ContainerStarted","Data":"23526c00274f1a3b543cc5f22b2ad297f8f186c5e5d0eb7191f08a8e11d3be64"} Jun 15 04:30:14.821692 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:14.821635 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhkm2" event={"ID":"7cd4563d-c0e0-463e-b183-b74a32d1ef66","Type":"ContainerStarted","Data":"09a518b7ea52086bad4a58c41cf434f5efc68b58e61ece647d9ce4edab74cc01"} Jun 15 04:30:14.822085 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:14.821744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhkm2" event={"ID":"7cd4563d-c0e0-463e-b183-b74a32d1ef66","Type":"ContainerStarted","Data":"7c8c9fea447358e43f51632949d83f3452f6ba64c4bb838c33f0c63d23ac8a87"} Jun 15 04:30:14.822085 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:14.821767 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fhkm2" Jun 15 04:30:14.841155 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:14.841108 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fhkm2" podStartSLOduration=251.331273101 podStartE2EDuration="4m12.841092307s" totalImagesPullingTime="1.509819206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:30:14.839305094 +0000 UTC m=+287.402600018" watchObservedRunningTime="2026-06-15 04:30:14.841092307 +0000 UTC m=+287.404387231" Jun 15 04:30:21.202777 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:21.202739 2554 patch_prober.go:28] interesting pod/image-registry-667c798b7d-jjw75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:30:21.203224 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:21.202790 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:30:24.828607 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:24.828573 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fhkm2" Jun 15 04:30:27.773949 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:27.773921 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:30:27.788058 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:27.788024 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:30:27.792821 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:27.792795 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:30:27.796772 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:27.796729 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 04:30:27.798287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:27.798261 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:30:31.202754 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:31.202724 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:30:36.218131 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:36.218091 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" podUID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerName="registry" containerID="cri-o://c1fd2109219c2fa1fd286132909866cacb6dd7a1baa32c93ecbe81c0e9fe7a13" gracePeriod=30 Jun 15 04:30:36.907397 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:36.907365 2554 generic.go:356] "Generic (PLEG): container finished" podID="a9b0df88-f0d9-4a95-8159-728a6e4f8633" containerID="68c734253f541b61cf590c7adece39871851f5616a052cb2a726852c010b2783" exitCode=0 Jun 15 04:30:36.907577 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:36.907404 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" event={"ID":"a9b0df88-f0d9-4a95-8159-728a6e4f8633","Type":"ContainerDied","Data":"68c734253f541b61cf590c7adece39871851f5616a052cb2a726852c010b2783"} Jun 15 04:30:36.907762 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:36.907748 2554 scope.go:117] "RemoveContainer" containerID="68c734253f541b61cf590c7adece39871851f5616a052cb2a726852c010b2783" Jun 15 04:30:37.613726 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:37.613575 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f46d5878-vxjd7_d41d8e9b-3491-4d50-8451-424688a6347e/router/0.log" Jun 15 04:30:37.624715 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:37.624665 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clxdp_79938686-4627-46c4-83fd-13a544b741c2/serve-healthcheck-canary/0.log" Jun 15 04:30:37.915276 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:37.915187 2554 generic.go:356] "Generic (PLEG): container finished" podID="e51c63b2-cb96-4905-92ce-90f45b848cdd" containerID="c1fd2109219c2fa1fd286132909866cacb6dd7a1baa32c93ecbe81c0e9fe7a13" exitCode=0 Jun 15 04:30:37.915443 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:37.915277 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" event={"ID":"e51c63b2-cb96-4905-92ce-90f45b848cdd","Type":"ContainerDied","Data":"c1fd2109219c2fa1fd286132909866cacb6dd7a1baa32c93ecbe81c0e9fe7a13"} Jun 15 04:30:37.915443 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:37.915338 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:30:37.915443 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:37.915358 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" event={"ID":"e51c63b2-cb96-4905-92ce-90f45b848cdd","Type":"ContainerStarted","Data":"6aa398730d6aaec9a7e421e2e6f1fefc2c5e7fc759cf127080ff26f8a2d9a3f3"} Jun 15 04:30:37.917001 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:37.916981 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-zxq74" event={"ID":"a9b0df88-f0d9-4a95-8159-728a6e4f8633","Type":"ContainerStarted","Data":"c5fe9acbc581a4fd686a39d0ab3e1ce83dd6dff41e10266d483e700c356c535e"} Jun 15 04:30:48.972149 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:48.972115 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:30:48.988638 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:48.988609 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:30:49.986357 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:49.986324 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:30:58.926085 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:30:58.926055 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-667c798b7d-jjw75" Jun 15 04:31:02.683437 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:02.683402 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:31:02.683886 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:02.683736 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="alertmanager" containerID="cri-o://4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01" gracePeriod=120 Jun 15 04:31:02.683886 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:02.683797 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-metric" containerID="cri-o://885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c" gracePeriod=120 Jun 15 04:31:02.683886 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:02.683832 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-web" containerID="cri-o://b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26" gracePeriod=120 Jun 15 04:31:02.683886 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:02.683844 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="config-reloader" containerID="cri-o://468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f" gracePeriod=120 Jun 15 04:31:02.684102 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:02.683869 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="prom-label-proxy" containerID="cri-o://0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c" gracePeriod=120 Jun 15 04:31:02.684102 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:02.683912 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy" containerID="cri-o://d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e" gracePeriod=120 Jun 15 04:31:03.033376 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033346 2554 generic.go:356] "Generic (PLEG): container finished" podID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerID="0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c" exitCode=0 Jun 15 04:31:03.033376 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033370 2554 generic.go:356] "Generic (PLEG): container finished" podID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerID="d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e" exitCode=0 Jun 15 04:31:03.033376 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033377 2554 generic.go:356] "Generic (PLEG): container finished" podID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerID="468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f" exitCode=0 Jun 15 04:31:03.033376 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033382 2554 generic.go:356] "Generic (PLEG): container finished" podID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerID="4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01" exitCode=0 Jun 15 04:31:03.033640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c"} Jun 15 04:31:03.033640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033487 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e"} Jun 15 04:31:03.033640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f"} Jun 15 04:31:03.033640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.033537 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01"} Jun 15 04:31:03.941494 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.941469 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:03.990628 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.990592 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-cluster-tls-config\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.990891 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.990652 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-tls-assets\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.990891 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.990727 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.990891 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.990766 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.990888 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-out\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.990939 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-metrics-client-ca\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.990966 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-web-config\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.991024 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-volume\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.991050 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-main-db\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991295 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.991099 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhp9s\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-kube-api-access-zhp9s\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991295 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.991135 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991295 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.991180 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.991295 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.991221 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"efc08f6d-3156-4e73-9815-a5e19775d6ca\" (UID: \"efc08f6d-3156-4e73-9815-a5e19775d6ca\") " Jun 15 04:31:03.992345 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.992255 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:31:03.992345 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.992285 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:03.992786 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.992733 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:03.995265 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.995221 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:03.995640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.995602 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:03.995867 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.995832 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:03.995935 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.995917 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:31:03.996507 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.996464 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-volume" (OuterVolumeSpecName: "config-volume") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:03.996507 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.996492 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-out" (OuterVolumeSpecName: "config-out") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:31:03.996637 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.996614 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-kube-api-access-zhp9s" (OuterVolumeSpecName: "kube-api-access-zhp9s") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "kube-api-access-zhp9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:31:03.998001 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:03.997973 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:04.001728 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.001706 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:04.008005 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.007981 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-web-config" (OuterVolumeSpecName: "web-config") pod "efc08f6d-3156-4e73-9815-a5e19775d6ca" (UID: "efc08f6d-3156-4e73-9815-a5e19775d6ca"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:04.040843 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.040806 2554 generic.go:356] "Generic (PLEG): container finished" podID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerID="885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c" exitCode=0 Jun 15 04:31:04.040843 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.040836 2554 generic.go:356] "Generic (PLEG): container finished" podID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerID="b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26" exitCode=0 Jun 15 04:31:04.041049 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.040892 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.041049 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.040892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c"} Jun 15 04:31:04.041049 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.040980 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26"} Jun 15 04:31:04.041049 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.041023 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efc08f6d-3156-4e73-9815-a5e19775d6ca","Type":"ContainerDied","Data":"957da2b7b6dadb88c3f747525b00e5da0f8b0c0a4dd269183ae65784b0a4bdd6"} Jun 15 04:31:04.041230 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.041061 2554 scope.go:117] "RemoveContainer" containerID="0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c" Jun 15 04:31:04.048737 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.048712 2554 scope.go:117] "RemoveContainer" containerID="885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c" Jun 15 04:31:04.055807 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.055791 2554 scope.go:117] "RemoveContainer" containerID="d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e" Jun 15 04:31:04.063483 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.063462 2554 scope.go:117] "RemoveContainer" containerID="b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26" Jun 15 04:31:04.064317 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.064294 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:31:04.067153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.067128 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:31:04.070799 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.070780 2554 scope.go:117] "RemoveContainer" containerID="468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f" Jun 15 04:31:04.078090 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.078067 2554 scope.go:117] "RemoveContainer" containerID="4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01" Jun 15 04:31:04.085978 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.085962 2554 scope.go:117] "RemoveContainer" containerID="d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d" Jun 15 04:31:04.092535 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092508 2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-volume\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092544 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-main-db\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092561 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhp9s\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-kube-api-access-zhp9s\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092577 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092592 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092606 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092621 2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-cluster-tls-config\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092634 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efc08f6d-3156-4e73-9815-a5e19775d6ca-tls-assets\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092646 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-main-tls\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092658 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092707 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efc08f6d-3156-4e73-9815-a5e19775d6ca-config-out\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092722 2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efc08f6d-3156-4e73-9815-a5e19775d6ca-metrics-client-ca\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.092773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.092733 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efc08f6d-3156-4e73-9815-a5e19775d6ca-web-config\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:04.093366 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.093334 2554 scope.go:117] "RemoveContainer" containerID="0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c" Jun 15 04:31:04.093710 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:04.093660 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c\": container with ID starting with 0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c not found: ID does not exist" containerID="0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c" Jun 15 04:31:04.093767 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.093719 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c"} err="failed to get container status \"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c\": rpc error: code = NotFound desc = could not find container \"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c\": container with ID starting with 0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c not found: ID does not exist" Jun 15 04:31:04.093767 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.093738 2554 scope.go:117] "RemoveContainer" containerID="885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c" Jun 15 04:31:04.094008 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:04.093992 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c\": container with ID starting with 885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c not found: ID does not exist" containerID="885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c" Jun 15 04:31:04.094063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094021 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c"} err="failed to get container status \"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c\": rpc error: code = NotFound desc = could not find container \"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c\": container with ID starting with 885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c not found: ID does not exist" Jun 15 04:31:04.094063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094039 2554 scope.go:117] "RemoveContainer" containerID="d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e" Jun 15 04:31:04.094277 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:04.094254 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e\": container with ID starting with d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e not found: ID does not exist" containerID="d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e" Jun 15 04:31:04.094385 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094277 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e"} err="failed to get container status \"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e\": rpc error: code = NotFound desc = could not find container \"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e\": container with ID starting with d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e not found: ID does not exist" Jun 15 04:31:04.094385 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094292 2554 scope.go:117] "RemoveContainer" containerID="b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26" Jun 15 04:31:04.094547 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:04.094483 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26\": container with ID starting with b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26 not found: ID does not exist" containerID="b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26" Jun 15 04:31:04.094547 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094503 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26"} err="failed to get container status \"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26\": rpc error: code = NotFound desc = could not find container \"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26\": container with ID starting with b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26 not found: ID does not exist" Jun 15 04:31:04.094547 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094515 2554 scope.go:117] "RemoveContainer" containerID="468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f" Jun 15 04:31:04.094828 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:04.094807 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f\": container with ID starting with 468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f not found: ID does not exist" containerID="468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f" Jun 15 04:31:04.094937 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094824 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:31:04.094937 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094830 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f"} err="failed to get container status \"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f\": rpc error: code = NotFound desc = could not find container \"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f\": container with ID starting with 468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f not found: ID does not exist" Jun 15 04:31:04.094937 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.094846 2554 scope.go:117] "RemoveContainer" containerID="4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01" Jun 15 04:31:04.095127 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:04.095066 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01\": container with ID starting with 4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01 not found: ID does not exist" containerID="4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01" Jun 15 04:31:04.095127 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095088 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01"} err="failed to get container status \"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01\": rpc error: code = NotFound desc = could not find container \"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01\": container with ID starting with 4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01 not found: ID does not exist" Jun 15 04:31:04.095127 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095108 2554 scope.go:117] "RemoveContainer" containerID="d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d" Jun 15 04:31:04.095293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095220 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="alertmanager" Jun 15 04:31:04.095293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095237 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="alertmanager" Jun 15 04:31:04.095293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095251 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy" Jun 15 04:31:04.095293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095260 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy" Jun 15 04:31:04.095293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095272 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="init-config-reloader" Jun 15 04:31:04.095293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095281 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="init-config-reloader" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095298 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="prom-label-proxy" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095306 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="prom-label-proxy" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095326 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-web" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095334 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-web" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095352 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="config-reloader" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095362 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="config-reloader" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:04.095362 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d\": container with ID starting with d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d not found: ID does not exist" containerID="d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095377 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-metric" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095386 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-metric" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095388 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d"} err="failed to get container status \"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d\": rpc error: code = NotFound desc = could not find container \"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d\": container with ID starting with d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d not found: ID does not exist" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095404 2554 scope.go:117] "RemoveContainer" containerID="0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095455 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-web" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095469 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="prom-label-proxy" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095478 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="alertmanager" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095489 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095498 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="config-reloader" Jun 15 04:31:04.095581 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095507 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" containerName="kube-rbac-proxy-metric" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095626 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c"} err="failed to get container status \"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c\": rpc error: code = NotFound desc = could not find container \"0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c\": container with ID starting with 0a8dd931627af6548623dba6e6aeedba501d1d9be25ea0fa6ac869866e781e9c not found: ID does not exist" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095650 2554 scope.go:117] "RemoveContainer" containerID="885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095920 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c"} err="failed to get container status \"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c\": rpc error: code = NotFound desc = could not find container \"885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c\": container with ID starting with 885091bd83019de28293e14abfcaf297c88127bea6a71625d4feb4961336765c not found: ID does not exist" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.095936 2554 scope.go:117] "RemoveContainer" containerID="d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096138 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e"} err="failed to get container status \"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e\": rpc error: code = NotFound desc = could not find container \"d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e\": container with ID starting with d663dd05d4966f6a275b44471aa2528938016c7a4fc7cf47ded309a64bdb105e not found: ID does not exist" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096150 2554 scope.go:117] "RemoveContainer" containerID="b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096340 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26"} err="failed to get container status \"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26\": rpc error: code = NotFound desc = could not find container \"b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26\": container with ID starting with b40f98e9f7bd37c3ead3f9d47553bf2d1ece371f64498efb71277bf8cc535e26 not found: ID does not exist" Jun 15 04:31:04.096418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096364 2554 scope.go:117] "RemoveContainer" containerID="468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f" Jun 15 04:31:04.096838 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096549 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f"} err="failed to get container status \"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f\": rpc error: code = NotFound desc = could not find container \"468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f\": container with ID starting with 468656077a0d576367d3edee599938753f8b60f978bde1e197b10714da1c227f not found: ID does not exist" Jun 15 04:31:04.096838 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096563 2554 scope.go:117] "RemoveContainer" containerID="4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01" Jun 15 04:31:04.096838 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096770 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01"} err="failed to get container status \"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01\": rpc error: code = NotFound desc = could not find container \"4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01\": container with ID starting with 4e393c7551d8528b1d9355f147b2f4f8c80a31eac1c5d85d76262749651f7c01 not found: ID does not exist" Jun 15 04:31:04.096838 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.096784 2554 scope.go:117] "RemoveContainer" containerID="d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d" Jun 15 04:31:04.101401 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.097231 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d"} err="failed to get container status \"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d\": rpc error: code = NotFound desc = could not find container \"d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d\": container with ID starting with d1b10431ea643393b318222cd605bc04c678569abbef0f9cb4799718acdbaa5d not found: ID does not exist" Jun 15 04:31:04.102538 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.102519 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.105063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105045 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 04:31:04.105180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105045 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 04:31:04.105180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105130 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 04:31:04.105324 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105184 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 04:31:04.105480 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105389 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 04:31:04.105557 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105488 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 04:31:04.105771 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105737 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 04:31:04.105771 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105744 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8hxch\"" Jun 15 04:31:04.106027 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.105744 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 04:31:04.111135 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.111112 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 04:31:04.112707 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.112661 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:31:04.193633 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.193633 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193639 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.193873 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193667 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-config-out\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.193873 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-web-config\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.193873 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.193873 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zlg\" (UniqueName: \"kubernetes.io/projected/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-kube-api-access-z4zlg\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.193873 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.193873 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193863 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.194056 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193901 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.194056 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.194056 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193961 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.194056 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.193992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.194056 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.194018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.294841 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.294752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.294841 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.294793 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-config-out\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.294841 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.294812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-web-config\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.294841 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.294835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295125 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.294961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zlg\" (UniqueName: \"kubernetes.io/projected/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-kube-api-access-z4zlg\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295125 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295224 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295138 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295273 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295273 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295253 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295383 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295357 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295472 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295472 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295454 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295571 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295571 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.295994 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.295961 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.296296 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.296274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.297970 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.297938 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.298077 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.298008 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-config-out\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.298077 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.298041 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.298155 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.298083 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.298155 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.298148 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-web-config\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.298548 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.298532 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.298901 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.298884 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.299077 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.299053 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.299926 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.299910 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.302505 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.302483 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zlg\" (UniqueName: \"kubernetes.io/projected/5d4b2bde-d8fc-4d58-84e5-c864f05f33ef-kube-api-access-z4zlg\") pod \"alertmanager-main-0\" (UID: \"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.414374 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.414338 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 04:31:04.548730 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:04.548642 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 04:31:04.551307 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:31:04.551276 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4b2bde_d8fc_4d58_84e5_c864f05f33ef.slice/crio-2953ec6c09c7b6bed2166435fe20f1bbfbbef3005b18c33258e67a4e81720cdd WatchSource:0}: Error finding container 2953ec6c09c7b6bed2166435fe20f1bbfbbef3005b18c33258e67a4e81720cdd: Status 404 returned error can't find the container with id 2953ec6c09c7b6bed2166435fe20f1bbfbbef3005b18c33258e67a4e81720cdd Jun 15 04:31:05.045760 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:05.045725 2554 generic.go:356] "Generic (PLEG): container finished" podID="5d4b2bde-d8fc-4d58-84e5-c864f05f33ef" containerID="57c4fc0e1ad35ffb3d4a4de468124ea8fa9258d43e5299077454f87be78db421" exitCode=0 Jun 15 04:31:05.046243 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:05.045815 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerDied","Data":"57c4fc0e1ad35ffb3d4a4de468124ea8fa9258d43e5299077454f87be78db421"} Jun 15 04:31:05.046243 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:05.045888 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerStarted","Data":"2953ec6c09c7b6bed2166435fe20f1bbfbbef3005b18c33258e67a4e81720cdd"} Jun 15 04:31:05.828776 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:05.828742 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc08f6d-3156-4e73-9815-a5e19775d6ca" path="/var/lib/kubelet/pods/efc08f6d-3156-4e73-9815-a5e19775d6ca/volumes" Jun 15 04:31:06.055051 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.055015 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerStarted","Data":"d5e098c271e7f1eb08ebd3e290bcdb06a5d27a31f03662b5fffa4d921eba5291"} Jun 15 04:31:06.055419 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.055086 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerStarted","Data":"5b82515bdccbac040a9c2ec5d066a5e33a86555cac3cfa0afac044eacb530247"} Jun 15 04:31:06.055419 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.055117 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerStarted","Data":"351e06935d4170665f09167a73d4b6d6e82a7786c478b34c956547830cf22b8e"} Jun 15 04:31:06.055419 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.055144 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerStarted","Data":"1b14dc52ddde75d2678bd8c99e66cd69b616303ff45a7a2616efef2cded2ef67"} Jun 15 04:31:06.055419 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.055167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerStarted","Data":"a87ae735f064722408b178f34cc579666e16de2a6ff317c2f1baf65f7f521dfd"} Jun 15 04:31:06.055419 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.055194 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d4b2bde-d8fc-4d58-84e5-c864f05f33ef","Type":"ContainerStarted","Data":"61c175c4f549fcef33fb242258221e238531daf7749e2f1bba517336f0fd3f94"} Jun 15 04:31:06.079701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.079559 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.063724924 podStartE2EDuration="2.079535855s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.810931ms" isStatefulPod=false podCreationTimestamp="2026-06-15 04:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:31:06.076732768 +0000 UTC m=+338.640027711" watchObservedRunningTime="2026-06-15 04:31:06.079535855 +0000 UTC m=+338.642830780" Jun 15 04:31:06.964199 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.964149 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:31:06.964792 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.964616 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1" gracePeriod=600 Jun 15 04:31:06.964792 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.964739 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="prometheus" containerID="cri-o://6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29" gracePeriod=600 Jun 15 04:31:06.965007 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.964868 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy" containerID="cri-o://09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf" gracePeriod=600 Jun 15 04:31:06.965007 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.964897 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-web" containerID="cri-o://7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1" gracePeriod=600 Jun 15 04:31:06.965007 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.964860 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="thanos-sidecar" containerID="cri-o://5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c" gracePeriod=600 Jun 15 04:31:06.965007 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:06.964891 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="config-reloader" containerID="cri-o://33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345" gracePeriod=600 Jun 15 04:31:08.068816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068787 2554 generic.go:356] "Generic (PLEG): container finished" podID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerID="9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1" exitCode=0 Jun 15 04:31:08.068816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068812 2554 generic.go:356] "Generic (PLEG): container finished" podID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerID="09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf" exitCode=0 Jun 15 04:31:08.068816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068819 2554 generic.go:356] "Generic (PLEG): container finished" podID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerID="5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c" exitCode=0 Jun 15 04:31:08.069197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068824 2554 generic.go:356] "Generic (PLEG): container finished" podID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerID="33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345" exitCode=0 Jun 15 04:31:08.069197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068830 2554 generic.go:356] "Generic (PLEG): container finished" podID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerID="6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29" exitCode=0 Jun 15 04:31:08.069197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068858 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1"} Jun 15 04:31:08.069197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf"} Jun 15 04:31:08.069197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068956 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c"} Jun 15 04:31:08.069197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.068984 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345"} Jun 15 04:31:08.069197 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.069014 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29"} Jun 15 04:31:08.214474 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.214449 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:08.334035 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.333932 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334035 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.333981 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-tls-assets\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334035 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334006 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config-out\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334035 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334027 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-db\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334057 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-metrics-client-ca\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334079 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-1\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334116 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-web-config\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334149 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-tls\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334183 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-trusted-ca-bundle\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334210 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-grpc-tls\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334251 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-kube-rbac-proxy\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334275 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334320 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-metrics-client-certs\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334375 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-0\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334428 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334444 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334461 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334523 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-thanos-prometheus-http-client-file\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334558 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-serving-certs-ca-bundle\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334593 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-kubelet-serving-ca-bundle\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334620 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzfs4\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-kube-api-access-vzfs4\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.334818 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334647 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-2\") pod \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\" (UID: \"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed\") " Jun 15 04:31:08.335282 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.334995 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-metrics-client-ca\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.335282 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.335025 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.335780 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.335492 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:31:08.336129 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.336077 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:08.336241 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.336211 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:08.336652 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.336494 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:08.337412 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.337368 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:08.337632 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.337600 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.338009 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.337991 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:08.338425 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.338398 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.338735 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.338706 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.338850 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.338729 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.339096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.339061 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.339096 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.339068 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:31:08.339343 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.339286 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config" (OuterVolumeSpecName: "config") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.339444 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.339346 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.339444 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.339369 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config-out" (OuterVolumeSpecName: "config-out") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:31:08.339634 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.339617 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.340321 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.340297 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-kube-api-access-vzfs4" (OuterVolumeSpecName: "kube-api-access-vzfs4") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "kube-api-access-vzfs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:31:08.349963 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.349938 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-web-config" (OuterVolumeSpecName: "web-config") pod "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" (UID: "c3d0bbeb-5bcb-4e5b-87f6-003d498717ed"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:08.435436 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435395 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435436 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435428 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435436 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435438 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435436 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435449 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435459 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435469 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzfs4\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-kube-api-access-vzfs4\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435478 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435486 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435497 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-tls-assets\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435506 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-config-out\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435514 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-k8s-db\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435523 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-web-config\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435531 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435540 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435548 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-grpc-tls\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435556 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-kube-rbac-proxy\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435565 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:08.435740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:08.435572 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed-secret-metrics-client-certs\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:31:09.076895 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.076863 2554 generic.go:356] "Generic (PLEG): container finished" podID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerID="7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1" exitCode=0 Jun 15 04:31:09.077283 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.076916 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1"} Jun 15 04:31:09.077283 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.076936 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.077283 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.076977 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c3d0bbeb-5bcb-4e5b-87f6-003d498717ed","Type":"ContainerDied","Data":"45c08419ad07afddc80b8011bb0f02d7198724da01135a1600e4c45a76294647"} Jun 15 04:31:09.077283 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.077008 2554 scope.go:117] "RemoveContainer" containerID="9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1" Jun 15 04:31:09.085793 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.085768 2554 scope.go:117] "RemoveContainer" containerID="09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf" Jun 15 04:31:09.093379 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.093359 2554 scope.go:117] "RemoveContainer" containerID="7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1" Jun 15 04:31:09.100815 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.100790 2554 scope.go:117] "RemoveContainer" containerID="5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c" Jun 15 04:31:09.102231 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.102208 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:31:09.105734 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.105696 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:31:09.108427 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.108409 2554 scope.go:117] "RemoveContainer" containerID="33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345" Jun 15 04:31:09.115583 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.115563 2554 scope.go:117] "RemoveContainer" containerID="6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29" Jun 15 04:31:09.123247 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.123221 2554 scope.go:117] "RemoveContainer" containerID="1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538" Jun 15 04:31:09.129977 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.129929 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:31:09.131586 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.131502 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="prometheus" Jun 15 04:31:09.131789 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.131773 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="prometheus" Jun 15 04:31:09.131926 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.131912 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy" Jun 15 04:31:09.132011 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132000 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy" Jun 15 04:31:09.132153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132138 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="init-config-reloader" Jun 15 04:31:09.132245 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132235 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="init-config-reloader" Jun 15 04:31:09.132320 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132311 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="config-reloader" Jun 15 04:31:09.132393 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132381 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="config-reloader" Jun 15 04:31:09.132471 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132462 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-thanos" Jun 15 04:31:09.132540 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132531 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-thanos" Jun 15 04:31:09.132616 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132607 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-web" Jun 15 04:31:09.132773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132759 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-web" Jun 15 04:31:09.132945 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.132932 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="thanos-sidecar" Jun 15 04:31:09.133015 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.133006 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="thanos-sidecar" Jun 15 04:31:09.133264 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.133250 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy" Jun 15 04:31:09.133348 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.133339 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-thanos" Jun 15 04:31:09.133450 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.133440 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="kube-rbac-proxy-web" Jun 15 04:31:09.133539 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.133530 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="config-reloader" Jun 15 04:31:09.133623 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.133614 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="thanos-sidecar" Jun 15 04:31:09.133815 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.133805 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" containerName="prometheus" Jun 15 04:31:09.138832 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.138813 2554 scope.go:117] "RemoveContainer" containerID="9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1" Jun 15 04:31:09.139167 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:09.139149 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1\": container with ID starting with 9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1 not found: ID does not exist" containerID="9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1" Jun 15 04:31:09.139246 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.139173 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1"} err="failed to get container status \"9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1\": rpc error: code = NotFound desc = could not find container \"9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1\": container with ID starting with 9ee99a25a06e259258d12032264b1da246ffa3d99a5b62c2faac0e6a2c0425b1 not found: ID does not exist" Jun 15 04:31:09.139246 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.139190 2554 scope.go:117] "RemoveContainer" containerID="09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf" Jun 15 04:31:09.139452 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:09.139437 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf\": container with ID starting with 09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf not found: ID does not exist" containerID="09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf" Jun 15 04:31:09.139493 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.139456 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf"} err="failed to get container status \"09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf\": rpc error: code = NotFound desc = could not find container \"09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf\": container with ID starting with 09b29b84cb9151a1b5b9e0144e9c53b0192e77073f4d5e28bf2c1d71e444a7cf not found: ID does not exist" Jun 15 04:31:09.139493 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.139468 2554 scope.go:117] "RemoveContainer" containerID="7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1" Jun 15 04:31:09.139705 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:09.139668 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1\": container with ID starting with 7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1 not found: ID does not exist" containerID="7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1" Jun 15 04:31:09.139759 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.139713 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1"} err="failed to get container status \"7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1\": rpc error: code = NotFound desc = could not find container \"7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1\": container with ID starting with 7bbd92e405f43cd8dd263b22098c2d4f4be729cf6a0141876eb6eaa6352f92d1 not found: ID does not exist" Jun 15 04:31:09.139759 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.139734 2554 scope.go:117] "RemoveContainer" containerID="5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c" Jun 15 04:31:09.140011 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:09.139991 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c\": container with ID starting with 5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c not found: ID does not exist" containerID="5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c" Jun 15 04:31:09.140067 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.140016 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c"} err="failed to get container status \"5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c\": rpc error: code = NotFound desc = could not find container \"5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c\": container with ID starting with 5d14ed67c4347e71b0ff06d67336ad9f0e61f7dcb64080a8b0f1c05c6096412c not found: ID does not exist" Jun 15 04:31:09.140067 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.140032 2554 scope.go:117] "RemoveContainer" containerID="33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345" Jun 15 04:31:09.140287 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:09.140272 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345\": container with ID starting with 33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345 not found: ID does not exist" containerID="33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345" Jun 15 04:31:09.140332 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.140290 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345"} err="failed to get container status \"33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345\": rpc error: code = NotFound desc = could not find container \"33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345\": container with ID starting with 33460c1fec2ed1a573f89556acf5d72f5810ba624142bb5b61d3fbb00a17f345 not found: ID does not exist" Jun 15 04:31:09.140332 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.140302 2554 scope.go:117] "RemoveContainer" containerID="6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29" Jun 15 04:31:09.140534 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:09.140516 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29\": container with ID starting with 6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29 not found: ID does not exist" containerID="6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29" Jun 15 04:31:09.140574 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.140538 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29"} err="failed to get container status \"6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29\": rpc error: code = NotFound desc = could not find container \"6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29\": container with ID starting with 6c957ff8a59fc815baf80330635dd678a16cc593c65e6d63ef0747c9f9c29a29 not found: ID does not exist" Jun 15 04:31:09.140574 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.140550 2554 scope.go:117] "RemoveContainer" containerID="1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538" Jun 15 04:31:09.140786 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:31:09.140771 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538\": container with ID starting with 1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538 not found: ID does not exist" containerID="1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538" Jun 15 04:31:09.140828 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.140789 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538"} err="failed to get container status \"1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538\": rpc error: code = NotFound desc = could not find container \"1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538\": container with ID starting with 1993c2c3ff1afe195fc1dd3d05fe7e789df7fed3cabfece1fe4cb351fddc7538 not found: ID does not exist" Jun 15 04:31:09.141287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.141270 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.144605 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.144394 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 04:31:09.144605 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.144396 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 04:31:09.144883 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.144795 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 04:31:09.144944 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.144897 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 04:31:09.144997 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.144965 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7t4n5bemtdgip\"" Jun 15 04:31:09.145063 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145044 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145393 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145416 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145452 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145565 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145453 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v97x5\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145580 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 04:31:09.145723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.145650 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 04:31:09.146195 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.146160 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 04:31:09.147153 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.147051 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:31:09.149031 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.148888 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 04:31:09.150916 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.150894 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 04:31:09.241373 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241330 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15c0e28a-175e-4d3a-af0e-f9324a823e70-config-out\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241373 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241375 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241638 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241400 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241638 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241638 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241638 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241638 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-config\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241662 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241753 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241807 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.241830 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.242006 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.242006 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.242006 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241876 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-web-config\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.242006 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.242006 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.242006 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241931 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcgq\" (UniqueName: \"kubernetes.io/projected/15c0e28a-175e-4d3a-af0e-f9324a823e70-kube-api-access-jpcgq\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.242006 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.241949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15c0e28a-175e-4d3a-af0e-f9324a823e70-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342385 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342385 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342385 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342355 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342425 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342476 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-config\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342543 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342627 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.342656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-web-config\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcgq\" (UniqueName: \"kubernetes.io/projected/15c0e28a-175e-4d3a-af0e-f9324a823e70-kube-api-access-jpcgq\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342890 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15c0e28a-175e-4d3a-af0e-f9324a823e70-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342931 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15c0e28a-175e-4d3a-af0e-f9324a823e70-config-out\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343018 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.342980 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343506 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.343119 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343506 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.343266 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.343627 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.343509 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.344279 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.344255 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.345492 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.345593 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-config\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.345634 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.345899 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.346141 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15c0e28a-175e-4d3a-af0e-f9324a823e70-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.346164 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.346288 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.346421 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346479 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.346421 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.346990 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.346787 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15c0e28a-175e-4d3a-af0e-f9324a823e70-config-out\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.347644 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.347616 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-web-config\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.348247 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.348222 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.348411 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.348393 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.348608 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.348589 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15c0e28a-175e-4d3a-af0e-f9324a823e70-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.348746 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.348729 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15c0e28a-175e-4d3a-af0e-f9324a823e70-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.351433 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.351410 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcgq\" (UniqueName: \"kubernetes.io/projected/15c0e28a-175e-4d3a-af0e-f9324a823e70-kube-api-access-jpcgq\") pod \"prometheus-k8s-0\" (UID: \"15c0e28a-175e-4d3a-af0e-f9324a823e70\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.453764 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.453708 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:31:09.591016 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.590965 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 04:31:09.593114 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:31:09.593060 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c0e28a_175e_4d3a_af0e_f9324a823e70.slice/crio-ec6b3aed77cd9019cd187ea583864406f5393e933395a5b10591cfa0b6e1691b WatchSource:0}: Error finding container ec6b3aed77cd9019cd187ea583864406f5393e933395a5b10591cfa0b6e1691b: Status 404 returned error can't find the container with id ec6b3aed77cd9019cd187ea583864406f5393e933395a5b10591cfa0b6e1691b Jun 15 04:31:09.832121 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:09.832088 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d0bbeb-5bcb-4e5b-87f6-003d498717ed" path="/var/lib/kubelet/pods/c3d0bbeb-5bcb-4e5b-87f6-003d498717ed/volumes" Jun 15 04:31:10.081880 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:10.081840 2554 generic.go:356] "Generic (PLEG): container finished" podID="15c0e28a-175e-4d3a-af0e-f9324a823e70" containerID="47156026b6ae66225652ac7bd1dcaafe3b95de517601c70a4ec7eb5bfe324562" exitCode=0 Jun 15 04:31:10.082336 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:10.081932 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerDied","Data":"47156026b6ae66225652ac7bd1dcaafe3b95de517601c70a4ec7eb5bfe324562"} Jun 15 04:31:10.082336 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:10.082027 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerStarted","Data":"ec6b3aed77cd9019cd187ea583864406f5393e933395a5b10591cfa0b6e1691b"} Jun 15 04:31:11.089897 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:11.089860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerStarted","Data":"e649f21c0bbfa8e6509cd1549c5775f88fecc2fa311dff71a26cc469daa94915"} Jun 15 04:31:11.090324 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:11.089922 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerStarted","Data":"12fa413d1f8d3d089d799541a45c3c7a74f637547727473b5d5d301280ae3883"} Jun 15 04:31:11.090324 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:11.089951 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerStarted","Data":"3d2e1fcccf5ff7d672ec94668e74b443e6f19d6a7d5cbd77f90e8324210aa10b"} Jun 15 04:31:11.090324 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:11.089975 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerStarted","Data":"e80aead8fc2744a73ba3d3b0d02c4441b75ed5c7885feb633f5ca58a920e6eb2"} Jun 15 04:31:11.090324 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:11.089997 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerStarted","Data":"db1bc1d0cee8579cc5fb4f84ec60db711bc53b831d9964288b052fdf1ad609dd"} Jun 15 04:31:11.090324 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:11.090025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15c0e28a-175e-4d3a-af0e-f9324a823e70","Type":"ContainerStarted","Data":"9ef37e1119227d99267129a1d180d661a28e9b557169ce6ae3af0b19dd5011f2"} Jun 15 04:31:11.117493 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:11.117440 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.098582604 podStartE2EDuration="2.117423785s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.841181ms" isStatefulPod=false podCreationTimestamp="2026-06-15 04:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:31:11.115790983 +0000 UTC m=+343.679085928" watchObservedRunningTime="2026-06-15 04:31:11.117423785 +0000 UTC m=+343.680718709" Jun 15 04:31:14.453993 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:31:14.453944 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:32:09.454267 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:32:09.454223 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:32:09.470074 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:32:09.470044 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:32:10.336842 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:32:10.336814 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 04:34:07.968236 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.968193 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5"] Jun 15 04:34:07.971653 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.971630 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:07.974413 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.974387 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 04:34:07.974734 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.974715 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 04:34:07.974959 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.974943 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lnlct\"" Jun 15 04:34:07.975090 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.975073 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 04:34:07.975181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.975165 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 04:34:07.992287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:07.992261 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5"] Jun 15 04:34:08.092585 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.092544 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5e77790-a013-4b92-86c1-3bcec37b5a31-tmp\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.092585 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.092586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5e77790-a013-4b92-86c1-3bcec37b5a31-webhook-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.092824 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.092689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5e77790-a013-4b92-86c1-3bcec37b5a31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.092824 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.092766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5e77790-a013-4b92-86c1-3bcec37b5a31-manifests\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.092824 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.092797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmzlk\" (UniqueName: \"kubernetes.io/projected/e5e77790-a013-4b92-86c1-3bcec37b5a31-kube-api-access-nmzlk\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.193268 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.193227 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5e77790-a013-4b92-86c1-3bcec37b5a31-manifests\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.193507 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.193282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmzlk\" (UniqueName: \"kubernetes.io/projected/e5e77790-a013-4b92-86c1-3bcec37b5a31-kube-api-access-nmzlk\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.193507 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.193325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5e77790-a013-4b92-86c1-3bcec37b5a31-tmp\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.193507 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.193350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5e77790-a013-4b92-86c1-3bcec37b5a31-webhook-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.193507 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.193422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5e77790-a013-4b92-86c1-3bcec37b5a31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.193798 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.193749 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e5e77790-a013-4b92-86c1-3bcec37b5a31-manifests\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.195623 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.195589 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5e77790-a013-4b92-86c1-3bcec37b5a31-tmp\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.195956 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.195938 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e5e77790-a013-4b92-86c1-3bcec37b5a31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.196004 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.195951 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5e77790-a013-4b92-86c1-3bcec37b5a31-webhook-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.200922 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.200897 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmzlk\" (UniqueName: \"kubernetes.io/projected/e5e77790-a013-4b92-86c1-3bcec37b5a31-kube-api-access-nmzlk\") pod \"opendatahub-operator-controller-manager-54bcdff745-ddnc5\" (UID: \"e5e77790-a013-4b92-86c1-3bcec37b5a31\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.282918 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.282883 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:08.417009 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.416959 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5"] Jun 15 04:34:08.419869 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:34:08.419832 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e77790_a013_4b92_86c1_3bcec37b5a31.slice/crio-b40a1e31963232eec318947d64f0b0bb9b97d52e0d0822bafe0ae2b6218ea006 WatchSource:0}: Error finding container b40a1e31963232eec318947d64f0b0bb9b97d52e0d0822bafe0ae2b6218ea006: Status 404 returned error can't find the container with id b40a1e31963232eec318947d64f0b0bb9b97d52e0d0822bafe0ae2b6218ea006 Jun 15 04:34:08.421829 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.421809 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:34:08.792254 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:08.792218 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" event={"ID":"e5e77790-a013-4b92-86c1-3bcec37b5a31","Type":"ContainerStarted","Data":"b40a1e31963232eec318947d64f0b0bb9b97d52e0d0822bafe0ae2b6218ea006"} Jun 15 04:34:11.808137 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:11.808102 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" event={"ID":"e5e77790-a013-4b92-86c1-3bcec37b5a31","Type":"ContainerStarted","Data":"afa0c2f37a961a9e6741089d7454b4f989f4bf7650937e9108acc7d9e46a97b9"} Jun 15 04:34:12.813386 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:12.813344 2554 generic.go:356] "Generic (PLEG): container finished" podID="e5e77790-a013-4b92-86c1-3bcec37b5a31" containerID="afa0c2f37a961a9e6741089d7454b4f989f4bf7650937e9108acc7d9e46a97b9" exitCode=0 Jun 15 04:34:12.813897 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:12.813432 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" event={"ID":"e5e77790-a013-4b92-86c1-3bcec37b5a31","Type":"ContainerDied","Data":"afa0c2f37a961a9e6741089d7454b4f989f4bf7650937e9108acc7d9e46a97b9"} Jun 15 04:34:13.819360 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:13.819322 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" event={"ID":"e5e77790-a013-4b92-86c1-3bcec37b5a31","Type":"ContainerStarted","Data":"2e989cd440e76c364475c71d26857799a91e340ec790d725fdffe85594a80213"} Jun 15 04:34:13.819834 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:13.819459 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:13.842377 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:13.842325 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" podStartSLOduration=2.557451848 podStartE2EDuration="6.842308373s" totalImagesPullingTime="3.376071471s" totalInitContainerRuntime="908.785054ms" isStatefulPod=false podCreationTimestamp="2026-06-15 04:34:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:34:13.840353254 +0000 UTC m=+526.403648203" watchObservedRunningTime="2026-06-15 04:34:13.842308373 +0000 UTC m=+526.405603296" Jun 15 04:34:24.825333 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:24.825302 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-ddnc5" Jun 15 04:34:25.192293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.192217 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58"] Jun 15 04:34:25.200573 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.200548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.201948 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.201921 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58"] Jun 15 04:34:25.203266 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.203233 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 04:34:25.203266 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.203260 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:34:25.203457 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.203283 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 04:34:25.203457 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.203285 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hw49l\"" Jun 15 04:34:25.203614 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.203598 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 04:34:25.203667 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.203601 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 04:34:25.343791 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.343763 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f24c144-eed8-4be5-97d5-bccd1452486f-cert\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.343974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.343831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f24c144-eed8-4be5-97d5-bccd1452486f-manager-config\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.343974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.343881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjpvm\" (UniqueName: \"kubernetes.io/projected/1f24c144-eed8-4be5-97d5-bccd1452486f-kube-api-access-vjpvm\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.343974 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.343946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f24c144-eed8-4be5-97d5-bccd1452486f-metrics-cert\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.445186 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.445093 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f24c144-eed8-4be5-97d5-bccd1452486f-metrics-cert\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.445186 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.445147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f24c144-eed8-4be5-97d5-bccd1452486f-cert\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.445473 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.445216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f24c144-eed8-4be5-97d5-bccd1452486f-manager-config\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.445473 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.445267 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjpvm\" (UniqueName: \"kubernetes.io/projected/1f24c144-eed8-4be5-97d5-bccd1452486f-kube-api-access-vjpvm\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.445951 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.445930 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f24c144-eed8-4be5-97d5-bccd1452486f-manager-config\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.447663 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.447641 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f24c144-eed8-4be5-97d5-bccd1452486f-metrics-cert\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.447754 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.447697 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f24c144-eed8-4be5-97d5-bccd1452486f-cert\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.453869 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.453848 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjpvm\" (UniqueName: \"kubernetes.io/projected/1f24c144-eed8-4be5-97d5-bccd1452486f-kube-api-access-vjpvm\") pod \"lws-controller-manager-56698c95d7-vpt58\" (UID: \"1f24c144-eed8-4be5-97d5-bccd1452486f\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.511768 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.511724 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:25.638816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.638791 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58"] Jun 15 04:34:25.641761 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:34:25.641734 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f24c144_eed8_4be5_97d5_bccd1452486f.slice/crio-a5070f07790ab23c219d38fc7adcc0b51f288469d1336ad917fb0f3813f70d4e WatchSource:0}: Error finding container a5070f07790ab23c219d38fc7adcc0b51f288469d1336ad917fb0f3813f70d4e: Status 404 returned error can't find the container with id a5070f07790ab23c219d38fc7adcc0b51f288469d1336ad917fb0f3813f70d4e Jun 15 04:34:25.868978 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:25.868936 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" event={"ID":"1f24c144-eed8-4be5-97d5-bccd1452486f","Type":"ContainerStarted","Data":"a5070f07790ab23c219d38fc7adcc0b51f288469d1336ad917fb0f3813f70d4e"} Jun 15 04:34:27.320398 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.320362 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5"] Jun 15 04:34:27.329744 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.329713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.333184 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.332851 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 04:34:27.333184 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.332935 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 04:34:27.333184 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.332850 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hd2zz\"" Jun 15 04:34:27.336136 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.335902 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5"] Jun 15 04:34:27.466269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.466227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgb7\" (UniqueName: \"kubernetes.io/projected/66582d92-62c5-44c2-b1b5-47229dbb3655-kube-api-access-5wgb7\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.466463 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.466292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66582d92-62c5-44c2-b1b5-47229dbb3655-tls-certs\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.466463 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.466336 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66582d92-62c5-44c2-b1b5-47229dbb3655-tmp\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.567882 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.567843 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgb7\" (UniqueName: \"kubernetes.io/projected/66582d92-62c5-44c2-b1b5-47229dbb3655-kube-api-access-5wgb7\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.568072 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.567903 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66582d92-62c5-44c2-b1b5-47229dbb3655-tls-certs\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.568072 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.567946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66582d92-62c5-44c2-b1b5-47229dbb3655-tmp\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.570838 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.570767 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66582d92-62c5-44c2-b1b5-47229dbb3655-tmp\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.571178 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.571151 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66582d92-62c5-44c2-b1b5-47229dbb3655-tls-certs\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.577141 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.577108 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgb7\" (UniqueName: \"kubernetes.io/projected/66582d92-62c5-44c2-b1b5-47229dbb3655-kube-api-access-5wgb7\") pod \"kube-auth-proxy-f88fdf6c8-grdb5\" (UID: \"66582d92-62c5-44c2-b1b5-47229dbb3655\") " pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:27.643976 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:27.643938 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" Jun 15 04:34:28.186768 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:28.186737 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5"] Jun 15 04:34:28.189055 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:34:28.189029 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66582d92_62c5_44c2_b1b5_47229dbb3655.slice/crio-d7e2046009883baf2b5455bbd746bf3dcbdd19badefc89026a65d2502bc1009e WatchSource:0}: Error finding container d7e2046009883baf2b5455bbd746bf3dcbdd19badefc89026a65d2502bc1009e: Status 404 returned error can't find the container with id d7e2046009883baf2b5455bbd746bf3dcbdd19badefc89026a65d2502bc1009e Jun 15 04:34:28.887972 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:28.887932 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" event={"ID":"1f24c144-eed8-4be5-97d5-bccd1452486f","Type":"ContainerStarted","Data":"599c2c7f61d25cf919ee6ada2d7a0d97edbd06d2f7a3412291fc4f923f3d2148"} Jun 15 04:34:28.888444 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:28.888422 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:34:28.890008 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:28.889974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" event={"ID":"66582d92-62c5-44c2-b1b5-47229dbb3655","Type":"ContainerStarted","Data":"d7e2046009883baf2b5455bbd746bf3dcbdd19badefc89026a65d2502bc1009e"} Jun 15 04:34:28.905917 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:28.905854 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" podStartSLOduration=1.447684839 podStartE2EDuration="3.905833154s" totalImagesPullingTime="2.458148315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:34:28.904160399 +0000 UTC m=+541.467455340" watchObservedRunningTime="2026-06-15 04:34:28.905833154 +0000 UTC m=+541.469128083" Jun 15 04:34:30.779950 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:30.779925 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 04:34:30.900896 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:30.900858 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" event={"ID":"66582d92-62c5-44c2-b1b5-47229dbb3655","Type":"ContainerStarted","Data":"1c4b6bc36e30fdfcb3144f15f8e0c5811018bd85319daf66991e74dadd25cb92"} Jun 15 04:34:30.918802 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:30.918752 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f88fdf6c8-grdb5" podStartSLOduration=1.332635008 podStartE2EDuration="3.918738582s" totalImagesPullingTime="2.586103574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:34:30.917593355 +0000 UTC m=+543.480888289" watchObservedRunningTime="2026-06-15 04:34:30.918738582 +0000 UTC m=+543.482033506" Jun 15 04:34:39.898450 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:34:39.898410 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-vpt58" Jun 15 04:35:27.814072 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:35:27.814044 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:35:27.816350 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:35:27.816326 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:35:27.822207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:35:27.822186 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:35:27.824039 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:35:27.824017 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:36:11.459662 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.459625 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs"] Jun 15 04:36:11.463054 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.463038 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.465525 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.465502 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 04:36:11.465656 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.465638 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 15 04:36:11.465743 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.465714 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rdghc\"" Jun 15 04:36:11.466685 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.466643 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 15 04:36:11.466801 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.466731 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 04:36:11.476796 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.476770 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs"] Jun 15 04:36:11.599578 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.599537 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtws\" (UniqueName: \"kubernetes.io/projected/307fe53b-ed86-40c2-bdd3-e452eae74b5c-kube-api-access-hhtws\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.599578 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.599583 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/307fe53b-ed86-40c2-bdd3-e452eae74b5c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.599834 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.599707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/307fe53b-ed86-40c2-bdd3-e452eae74b5c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.700489 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.700452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtws\" (UniqueName: \"kubernetes.io/projected/307fe53b-ed86-40c2-bdd3-e452eae74b5c-kube-api-access-hhtws\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.700709 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.700500 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/307fe53b-ed86-40c2-bdd3-e452eae74b5c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.700709 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.700548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/307fe53b-ed86-40c2-bdd3-e452eae74b5c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.700709 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:11.700692 2554 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 15 04:36:11.700818 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:11.700765 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307fe53b-ed86-40c2-bdd3-e452eae74b5c-plugin-serving-cert podName:307fe53b-ed86-40c2-bdd3-e452eae74b5c nodeName:}" failed. No retries permitted until 2026-06-15 04:36:12.200748252 +0000 UTC m=+644.764043154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/307fe53b-ed86-40c2-bdd3-e452eae74b5c-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-gzsvs" (UID: "307fe53b-ed86-40c2-bdd3-e452eae74b5c") : secret "plugin-serving-cert" not found Jun 15 04:36:11.701151 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.701132 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/307fe53b-ed86-40c2-bdd3-e452eae74b5c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:11.710648 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:11.710577 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtws\" (UniqueName: \"kubernetes.io/projected/307fe53b-ed86-40c2-bdd3-e452eae74b5c-kube-api-access-hhtws\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:12.204483 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:12.204442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/307fe53b-ed86-40c2-bdd3-e452eae74b5c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:12.206936 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:12.206905 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/307fe53b-ed86-40c2-bdd3-e452eae74b5c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gzsvs\" (UID: \"307fe53b-ed86-40c2-bdd3-e452eae74b5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:12.380667 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:12.380633 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" Jun 15 04:36:12.517436 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:12.517411 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs"] Jun 15 04:36:12.519327 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:36:12.519301 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod307fe53b_ed86_40c2_bdd3_e452eae74b5c.slice/crio-130dbb516adab35ee29348c531615fa999cef1574f138d073084e69c6195b1af WatchSource:0}: Error finding container 130dbb516adab35ee29348c531615fa999cef1574f138d073084e69c6195b1af: Status 404 returned error can't find the container with id 130dbb516adab35ee29348c531615fa999cef1574f138d073084e69c6195b1af Jun 15 04:36:13.351418 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:13.351378 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" event={"ID":"307fe53b-ed86-40c2-bdd3-e452eae74b5c","Type":"ContainerStarted","Data":"130dbb516adab35ee29348c531615fa999cef1574f138d073084e69c6195b1af"} Jun 15 04:36:21.102324 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.102286 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn"] Jun 15 04:36:21.112321 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.112291 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.115947 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.115834 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b2srt\"" Jun 15 04:36:21.117859 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.117832 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn"] Jun 15 04:36:21.191688 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.191627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" (UID: \"62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.191881 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.191757 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvtfz\" (UniqueName: \"kubernetes.io/projected/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-kube-api-access-pvtfz\") pod \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" (UID: \"62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.211790 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.211754 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn"] Jun 15 04:36:21.212154 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:21.212108 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-pvtfz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" podUID="62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7" Jun 15 04:36:21.227369 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.227186 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn"] Jun 15 04:36:21.293256 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.293209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvtfz\" (UniqueName: \"kubernetes.io/projected/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-kube-api-access-pvtfz\") pod \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" (UID: \"62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.293452 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.293339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" (UID: \"62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.293852 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.293829 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" (UID: \"62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.296117 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:21.296088 2554 projected.go:196] Error preparing data for projected volume kube-api-access-pvtfz for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-236.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-236.ec2.internal' and this object Jun 15 04:36:21.296243 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:21.296180 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-kube-api-access-pvtfz podName:62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7 nodeName:}" failed. No retries permitted until 2026-06-15 04:36:21.79615995 +0000 UTC m=+654.359454855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pvtfz" (UniqueName: "kubernetes.io/projected/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-kube-api-access-pvtfz") pod "kuadrant-operator-controller-manager-86878c769f-rpsqn" (UID: "62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-136-236.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-136-236.ec2.internal' and this object Jun 15 04:36:21.399243 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.399155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.402262 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:21.402225 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" is forbidden: User \"system:node:ip-10-0-136-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-236.ec2.internal' and this object" podUID="62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.410386 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.410357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.413391 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:21.413350 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" is forbidden: User \"system:node:ip-10-0-136-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-236.ec2.internal' and this object" podUID="62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:21.495088 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.495051 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-extensions-socket-volume\") pod \"62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7\" (UID: \"62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7\") " Jun 15 04:36:21.495351 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.495322 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7" (UID: "62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:36:21.495448 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.495392 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvtfz\" (UniqueName: \"kubernetes.io/projected/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-kube-api-access-pvtfz\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:36:21.596929 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.596891 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7-extensions-socket-volume\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:36:21.829257 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:21.829220 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7" path="/var/lib/kubelet/pods/62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7/volumes" Jun 15 04:36:22.404773 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:22.404741 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:22.410018 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:36:22.409970 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-rpsqn\" is forbidden: User \"system:node:ip-10-0-136-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-236.ec2.internal' and this object" podUID="62d24ab9-9a98-45ca-8ba8-6a23b8e7efe7" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rpsqn" Jun 15 04:36:35.470136 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:35.470039 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" event={"ID":"307fe53b-ed86-40c2-bdd3-e452eae74b5c","Type":"ContainerStarted","Data":"7d65dfef6bf7502a99bf6e0f952e2737a5fb9c3db1f4e459df5ae32060ea277f"} Jun 15 04:36:35.485872 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:36:35.485822 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gzsvs" podStartSLOduration=1.912432072 podStartE2EDuration="24.485807275s" totalImagesPullingTime="22.573375203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:35.484548994 +0000 UTC m=+668.047843917" watchObservedRunningTime="2026-06-15 04:36:35.485807275 +0000 UTC m=+668.049102199" Jun 15 04:37:01.498856 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.498824 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:37:01.560181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.560148 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:37:01.560181 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.560185 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:37:01.560383 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.560263 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:01.562821 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.562790 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 04:37:01.646290 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.646246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lpzb\" (UniqueName: \"kubernetes.io/projected/fc023837-45ef-45dc-90a1-330e6f392600-kube-api-access-5lpzb\") pod \"limitador-limitador-54d6d988d5-pshh7\" (UID: \"fc023837-45ef-45dc-90a1-330e6f392600\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:01.646473 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.646306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc023837-45ef-45dc-90a1-330e6f392600-config-file\") pod \"limitador-limitador-54d6d988d5-pshh7\" (UID: \"fc023837-45ef-45dc-90a1-330e6f392600\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:01.747151 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.747109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc023837-45ef-45dc-90a1-330e6f392600-config-file\") pod \"limitador-limitador-54d6d988d5-pshh7\" (UID: \"fc023837-45ef-45dc-90a1-330e6f392600\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:01.747366 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.747224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lpzb\" (UniqueName: \"kubernetes.io/projected/fc023837-45ef-45dc-90a1-330e6f392600-kube-api-access-5lpzb\") pod \"limitador-limitador-54d6d988d5-pshh7\" (UID: \"fc023837-45ef-45dc-90a1-330e6f392600\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:01.747808 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.747783 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc023837-45ef-45dc-90a1-330e6f392600-config-file\") pod \"limitador-limitador-54d6d988d5-pshh7\" (UID: \"fc023837-45ef-45dc-90a1-330e6f392600\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:01.755269 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.755212 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lpzb\" (UniqueName: \"kubernetes.io/projected/fc023837-45ef-45dc-90a1-330e6f392600-kube-api-access-5lpzb\") pod \"limitador-limitador-54d6d988d5-pshh7\" (UID: \"fc023837-45ef-45dc-90a1-330e6f392600\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:01.870535 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:01.870498 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:02.003412 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.003379 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:37:02.006211 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:37:02.006148 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc023837_45ef_45dc_90a1_330e6f392600.slice/crio-f79746ae218860f0f07772200b29ee6f0de56abcf2cf4c5d4733c5ff63f32277 WatchSource:0}: Error finding container f79746ae218860f0f07772200b29ee6f0de56abcf2cf4c5d4733c5ff63f32277: Status 404 returned error can't find the container with id f79746ae218860f0f07772200b29ee6f0de56abcf2cf4c5d4733c5ff63f32277 Jun 15 04:37:02.009959 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.009934 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-76gwk"] Jun 15 04:37:02.014624 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.014603 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-76gwk" Jun 15 04:37:02.017048 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.017031 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ppwxw\"" Jun 15 04:37:02.019949 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.019927 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-76gwk"] Jun 15 04:37:02.050316 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.050277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5q8\" (UniqueName: \"kubernetes.io/projected/33f0173a-217d-4dae-8ee8-46b819bb5b18-kube-api-access-mn5q8\") pod \"authorino-75d556bd77-76gwk\" (UID: \"33f0173a-217d-4dae-8ee8-46b819bb5b18\") " pod="kuadrant-system/authorino-75d556bd77-76gwk" Jun 15 04:37:02.151804 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.151765 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5q8\" (UniqueName: \"kubernetes.io/projected/33f0173a-217d-4dae-8ee8-46b819bb5b18-kube-api-access-mn5q8\") pod \"authorino-75d556bd77-76gwk\" (UID: \"33f0173a-217d-4dae-8ee8-46b819bb5b18\") " pod="kuadrant-system/authorino-75d556bd77-76gwk" Jun 15 04:37:02.159566 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.159540 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5q8\" (UniqueName: \"kubernetes.io/projected/33f0173a-217d-4dae-8ee8-46b819bb5b18-kube-api-access-mn5q8\") pod \"authorino-75d556bd77-76gwk\" (UID: \"33f0173a-217d-4dae-8ee8-46b819bb5b18\") " pod="kuadrant-system/authorino-75d556bd77-76gwk" Jun 15 04:37:02.325124 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.325088 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-76gwk" Jun 15 04:37:02.474378 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.474234 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-76gwk"] Jun 15 04:37:02.477192 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:37:02.477158 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33f0173a_217d_4dae_8ee8_46b819bb5b18.slice/crio-4f26ea1e4783ab684fc9a3dc390eef9c24ff68abb17273f85246f3d2e28237b5 WatchSource:0}: Error finding container 4f26ea1e4783ab684fc9a3dc390eef9c24ff68abb17273f85246f3d2e28237b5: Status 404 returned error can't find the container with id 4f26ea1e4783ab684fc9a3dc390eef9c24ff68abb17273f85246f3d2e28237b5 Jun 15 04:37:02.593903 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.593766 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-76gwk" event={"ID":"33f0173a-217d-4dae-8ee8-46b819bb5b18","Type":"ContainerStarted","Data":"4f26ea1e4783ab684fc9a3dc390eef9c24ff68abb17273f85246f3d2e28237b5"} Jun 15 04:37:02.596854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:02.596769 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" event={"ID":"fc023837-45ef-45dc-90a1-330e6f392600","Type":"ContainerStarted","Data":"f79746ae218860f0f07772200b29ee6f0de56abcf2cf4c5d4733c5ff63f32277"} Jun 15 04:37:07.635563 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:07.635519 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-76gwk" event={"ID":"33f0173a-217d-4dae-8ee8-46b819bb5b18","Type":"ContainerStarted","Data":"1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde"} Jun 15 04:37:07.637122 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:07.637100 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" event={"ID":"fc023837-45ef-45dc-90a1-330e6f392600","Type":"ContainerStarted","Data":"e64de82fb577a7d7e2e1ff2f484c063daed029e0af9f8b89a38e2ded9bd6f398"} Jun 15 04:37:07.637204 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:07.637164 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:37:07.650548 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:07.650495 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-76gwk" podStartSLOduration=2.334298232 podStartE2EDuration="6.650481165s" totalImagesPullingTime="4.316182933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:37:07.649450444 +0000 UTC m=+700.212745369" watchObservedRunningTime="2026-06-15 04:37:07.650481165 +0000 UTC m=+700.213776088" Jun 15 04:37:07.668307 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:07.668228 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" podStartSLOduration=1.882378286 podStartE2EDuration="6.668207638s" totalImagesPullingTime="4.785829352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:37:07.667469778 +0000 UTC m=+700.230764730" watchObservedRunningTime="2026-06-15 04:37:07.668207638 +0000 UTC m=+700.231502563" Jun 15 04:37:18.642813 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:37:18.642784 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshh7" Jun 15 04:38:27.018584 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.018545 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5769888b9b-rsnzw"] Jun 15 04:38:27.020738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.020721 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5769888b9b-rsnzw" Jun 15 04:38:27.029474 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.029446 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5769888b9b-rsnzw"] Jun 15 04:38:27.147213 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.147176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6z8\" (UniqueName: \"kubernetes.io/projected/9f4cfdd9-c7b4-475c-8207-3054b7c1d04e-kube-api-access-bq6z8\") pod \"authorino-5769888b9b-rsnzw\" (UID: \"9f4cfdd9-c7b4-475c-8207-3054b7c1d04e\") " pod="kuadrant-system/authorino-5769888b9b-rsnzw" Jun 15 04:38:27.155149 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.155116 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5769888b9b-rsnzw"] Jun 15 04:38:27.155387 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:38:27.155367 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bq6z8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5769888b9b-rsnzw" podUID="9f4cfdd9-c7b4-475c-8207-3054b7c1d04e" Jun 15 04:38:27.184605 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.184572 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cbd7b9748-48zmw"] Jun 15 04:38:27.186883 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.186861 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.189615 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.189595 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 04:38:27.196866 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.196843 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cbd7b9748-48zmw"] Jun 15 04:38:27.248362 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.248331 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrzgb\" (UniqueName: \"kubernetes.io/projected/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-kube-api-access-qrzgb\") pod \"authorino-cbd7b9748-48zmw\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.248532 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.248385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6z8\" (UniqueName: \"kubernetes.io/projected/9f4cfdd9-c7b4-475c-8207-3054b7c1d04e-kube-api-access-bq6z8\") pod \"authorino-5769888b9b-rsnzw\" (UID: \"9f4cfdd9-c7b4-475c-8207-3054b7c1d04e\") " pod="kuadrant-system/authorino-5769888b9b-rsnzw" Jun 15 04:38:27.248532 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.248441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-tls-cert\") pod \"authorino-cbd7b9748-48zmw\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.256187 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.256160 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6z8\" (UniqueName: \"kubernetes.io/projected/9f4cfdd9-c7b4-475c-8207-3054b7c1d04e-kube-api-access-bq6z8\") pod \"authorino-5769888b9b-rsnzw\" (UID: \"9f4cfdd9-c7b4-475c-8207-3054b7c1d04e\") " pod="kuadrant-system/authorino-5769888b9b-rsnzw" Jun 15 04:38:27.349538 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.349503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrzgb\" (UniqueName: \"kubernetes.io/projected/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-kube-api-access-qrzgb\") pod \"authorino-cbd7b9748-48zmw\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.349764 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.349560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-tls-cert\") pod \"authorino-cbd7b9748-48zmw\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.351939 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.351911 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-tls-cert\") pod \"authorino-cbd7b9748-48zmw\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.357027 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.357004 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrzgb\" (UniqueName: \"kubernetes.io/projected/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-kube-api-access-qrzgb\") pod \"authorino-cbd7b9748-48zmw\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.495914 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.495881 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:38:27.624052 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.624023 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cbd7b9748-48zmw"] Jun 15 04:38:27.626028 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:38:27.626000 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fddd1cd_68fe_4b82_a1d2_96c5c7d945a4.slice/crio-fb9780d1a469925a59857684b784957fa6dda496bfbdb7433e244818dab146c4 WatchSource:0}: Error finding container fb9780d1a469925a59857684b784957fa6dda496bfbdb7433e244818dab146c4: Status 404 returned error can't find the container with id fb9780d1a469925a59857684b784957fa6dda496bfbdb7433e244818dab146c4 Jun 15 04:38:27.997188 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.997097 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbd7b9748-48zmw" event={"ID":"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4","Type":"ContainerStarted","Data":"9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1"} Jun 15 04:38:27.997188 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.997131 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5769888b9b-rsnzw" Jun 15 04:38:27.997188 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:27.997162 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbd7b9748-48zmw" event={"ID":"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4","Type":"ContainerStarted","Data":"fb9780d1a469925a59857684b784957fa6dda496bfbdb7433e244818dab146c4"} Jun 15 04:38:28.004088 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.004057 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5769888b9b-rsnzw" Jun 15 04:38:28.013693 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.013624 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cbd7b9748-48zmw" podStartSLOduration=0.728861592 podStartE2EDuration="1.013603565s" totalImagesPullingTime="284.741973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:38:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:38:28.013090589 +0000 UTC m=+780.576385517" watchObservedRunningTime="2026-06-15 04:38:28.013603565 +0000 UTC m=+780.576898490" Jun 15 04:38:28.041586 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.041070 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-76gwk"] Jun 15 04:38:28.041586 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.041268 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-76gwk" podUID="33f0173a-217d-4dae-8ee8-46b819bb5b18" containerName="authorino" containerID="cri-o://1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde" gracePeriod=30 Jun 15 04:38:28.056729 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.056062 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq6z8\" (UniqueName: \"kubernetes.io/projected/9f4cfdd9-c7b4-475c-8207-3054b7c1d04e-kube-api-access-bq6z8\") pod \"9f4cfdd9-c7b4-475c-8207-3054b7c1d04e\" (UID: \"9f4cfdd9-c7b4-475c-8207-3054b7c1d04e\") " Jun 15 04:38:28.058567 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.058533 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4cfdd9-c7b4-475c-8207-3054b7c1d04e-kube-api-access-bq6z8" (OuterVolumeSpecName: "kube-api-access-bq6z8") pod "9f4cfdd9-c7b4-475c-8207-3054b7c1d04e" (UID: "9f4cfdd9-c7b4-475c-8207-3054b7c1d04e"). InnerVolumeSpecName "kube-api-access-bq6z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:38:28.157203 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.157159 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq6z8\" (UniqueName: \"kubernetes.io/projected/9f4cfdd9-c7b4-475c-8207-3054b7c1d04e-kube-api-access-bq6z8\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:38:28.291836 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.291813 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-76gwk" Jun 15 04:38:28.359595 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.359564 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn5q8\" (UniqueName: \"kubernetes.io/projected/33f0173a-217d-4dae-8ee8-46b819bb5b18-kube-api-access-mn5q8\") pod \"33f0173a-217d-4dae-8ee8-46b819bb5b18\" (UID: \"33f0173a-217d-4dae-8ee8-46b819bb5b18\") " Jun 15 04:38:28.361733 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.361702 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f0173a-217d-4dae-8ee8-46b819bb5b18-kube-api-access-mn5q8" (OuterVolumeSpecName: "kube-api-access-mn5q8") pod "33f0173a-217d-4dae-8ee8-46b819bb5b18" (UID: "33f0173a-217d-4dae-8ee8-46b819bb5b18"). InnerVolumeSpecName "kube-api-access-mn5q8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:38:28.461355 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:28.461276 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn5q8\" (UniqueName: \"kubernetes.io/projected/33f0173a-217d-4dae-8ee8-46b819bb5b18-kube-api-access-mn5q8\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:38:29.003036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.003000 2554 generic.go:356] "Generic (PLEG): container finished" podID="33f0173a-217d-4dae-8ee8-46b819bb5b18" containerID="1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde" exitCode=0 Jun 15 04:38:29.003036 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.003040 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-76gwk" Jun 15 04:38:29.003276 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.003089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-76gwk" event={"ID":"33f0173a-217d-4dae-8ee8-46b819bb5b18","Type":"ContainerDied","Data":"1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde"} Jun 15 04:38:29.003276 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.003128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-76gwk" event={"ID":"33f0173a-217d-4dae-8ee8-46b819bb5b18","Type":"ContainerDied","Data":"4f26ea1e4783ab684fc9a3dc390eef9c24ff68abb17273f85246f3d2e28237b5"} Jun 15 04:38:29.003276 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.003146 2554 scope.go:117] "RemoveContainer" containerID="1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde" Jun 15 04:38:29.003276 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.003228 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5769888b9b-rsnzw" Jun 15 04:38:29.012936 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.012918 2554 scope.go:117] "RemoveContainer" containerID="1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde" Jun 15 04:38:29.013253 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:38:29.013228 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde\": container with ID starting with 1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde not found: ID does not exist" containerID="1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde" Jun 15 04:38:29.013347 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.013264 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde"} err="failed to get container status \"1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde\": rpc error: code = NotFound desc = could not find container \"1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde\": container with ID starting with 1d9d23df52defdfba346bd9ddf70025002ffcec09a86740e5eb273cf3fde3bde not found: ID does not exist" Jun 15 04:38:29.031217 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.031189 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5769888b9b-rsnzw"] Jun 15 04:38:29.034587 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.034563 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5769888b9b-rsnzw"] Jun 15 04:38:29.044045 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.044020 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-76gwk"] Jun 15 04:38:29.045848 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.045827 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-76gwk"] Jun 15 04:38:29.829689 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.829640 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f0173a-217d-4dae-8ee8-46b819bb5b18" path="/var/lib/kubelet/pods/33f0173a-217d-4dae-8ee8-46b819bb5b18/volumes" Jun 15 04:38:29.830011 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:29.829994 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f4cfdd9-c7b4-475c-8207-3054b7c1d04e" path="/var/lib/kubelet/pods/9f4cfdd9-c7b4-475c-8207-3054b7c1d04e/volumes" Jun 15 04:38:31.500985 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.500946 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cc5879d57-2rfbr"] Jun 15 04:38:31.501361 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.501316 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f0173a-217d-4dae-8ee8-46b819bb5b18" containerName="authorino" Jun 15 04:38:31.501361 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.501327 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f0173a-217d-4dae-8ee8-46b819bb5b18" containerName="authorino" Jun 15 04:38:31.501430 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.501392 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f0173a-217d-4dae-8ee8-46b819bb5b18" containerName="authorino" Jun 15 04:38:31.503982 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.503963 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:31.507457 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.507435 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 04:38:31.507580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.507491 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nrssn\"" Jun 15 04:38:31.507580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.507492 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 04:38:31.517522 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.517499 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc5879d57-2rfbr"] Jun 15 04:38:31.588730 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.588670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert\") pod \"maas-controller-5cc5879d57-2rfbr\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:31.588901 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.588733 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2v9\" (UniqueName: \"kubernetes.io/projected/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-kube-api-access-jr2v9\") pod \"maas-controller-5cc5879d57-2rfbr\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:31.686268 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.686234 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79cf7bb55f-48vcl"] Jun 15 04:38:31.688559 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.688542 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:31.689243 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.689215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert\") pod \"maas-controller-5cc5879d57-2rfbr\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:31.689357 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.689244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2v9\" (UniqueName: \"kubernetes.io/projected/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-kube-api-access-jr2v9\") pod \"maas-controller-5cc5879d57-2rfbr\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:31.689399 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:38:31.689361 2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 15 04:38:31.689433 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:38:31.689407 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert podName:65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1 nodeName:}" failed. No retries permitted until 2026-06-15 04:38:32.189393022 +0000 UTC m=+784.752687924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert") pod "maas-controller-5cc5879d57-2rfbr" (UID: "65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1") : secret "maas-controller-webhook-cert" not found Jun 15 04:38:31.696634 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.696610 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79cf7bb55f-48vcl"] Jun 15 04:38:31.702280 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.702245 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2v9\" (UniqueName: \"kubernetes.io/projected/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-kube-api-access-jr2v9\") pod \"maas-controller-5cc5879d57-2rfbr\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:31.790799 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.790757 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-webhook-cert\") pod \"maas-controller-79cf7bb55f-48vcl\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:31.790979 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.790871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6z5p\" (UniqueName: \"kubernetes.io/projected/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-kube-api-access-z6z5p\") pod \"maas-controller-79cf7bb55f-48vcl\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:31.891762 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.891724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6z5p\" (UniqueName: \"kubernetes.io/projected/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-kube-api-access-z6z5p\") pod \"maas-controller-79cf7bb55f-48vcl\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:31.891950 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.891823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-webhook-cert\") pod \"maas-controller-79cf7bb55f-48vcl\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:31.894273 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.894252 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-webhook-cert\") pod \"maas-controller-79cf7bb55f-48vcl\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:31.899964 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.899937 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6z5p\" (UniqueName: \"kubernetes.io/projected/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-kube-api-access-z6z5p\") pod \"maas-controller-79cf7bb55f-48vcl\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:31.998928 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:31.998894 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:32.125711 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:32.125664 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79cf7bb55f-48vcl"] Jun 15 04:38:32.127406 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:38:32.127377 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b5bce6_c7ab_4fd8_a5fc_3ac6f8bc103f.slice/crio-945944aaec68f6cbebd843dc89feaa3a251ae2de06caaed20d8bb1c94dd05447 WatchSource:0}: Error finding container 945944aaec68f6cbebd843dc89feaa3a251ae2de06caaed20d8bb1c94dd05447: Status 404 returned error can't find the container with id 945944aaec68f6cbebd843dc89feaa3a251ae2de06caaed20d8bb1c94dd05447 Jun 15 04:38:32.195580 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:32.195549 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert\") pod \"maas-controller-5cc5879d57-2rfbr\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:32.197909 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:32.197889 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert\") pod \"maas-controller-5cc5879d57-2rfbr\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:32.414777 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:32.414687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:32.544486 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:32.544459 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc5879d57-2rfbr"] Jun 15 04:38:32.546049 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:38:32.546024 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e87a1f_dde6_45e9_bb6d_cd7ebaac17a1.slice/crio-f498840d7d606ef86a7e2fd88bdaec6827e28237b6031ec8a8f96203b89420d4 WatchSource:0}: Error finding container f498840d7d606ef86a7e2fd88bdaec6827e28237b6031ec8a8f96203b89420d4: Status 404 returned error can't find the container with id f498840d7d606ef86a7e2fd88bdaec6827e28237b6031ec8a8f96203b89420d4 Jun 15 04:38:33.029117 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:33.029079 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" event={"ID":"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1","Type":"ContainerStarted","Data":"f498840d7d606ef86a7e2fd88bdaec6827e28237b6031ec8a8f96203b89420d4"} Jun 15 04:38:33.030696 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:33.030615 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" event={"ID":"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f","Type":"ContainerStarted","Data":"945944aaec68f6cbebd843dc89feaa3a251ae2de06caaed20d8bb1c94dd05447"} Jun 15 04:38:36.047252 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:36.047196 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" event={"ID":"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f","Type":"ContainerStarted","Data":"83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943"} Jun 15 04:38:36.047729 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:36.047273 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:36.048770 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:36.048747 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" event={"ID":"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1","Type":"ContainerStarted","Data":"56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19"} Jun 15 04:38:36.048853 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:36.048804 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:36.065339 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:36.065290 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" podStartSLOduration=2.143056075 podStartE2EDuration="5.065276049s" totalImagesPullingTime="2.922219974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:38:36.063126581 +0000 UTC m=+788.626421518" watchObservedRunningTime="2026-06-15 04:38:36.065276049 +0000 UTC m=+788.628570973" Jun 15 04:38:36.078191 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:36.078149 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" podStartSLOduration=2.58597454 podStartE2EDuration="5.078135239s" totalImagesPullingTime="2.492160699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:38:36.077028198 +0000 UTC m=+788.640323142" watchObservedRunningTime="2026-06-15 04:38:36.078135239 +0000 UTC m=+788.641430163" Jun 15 04:38:47.058502 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.058426 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:47.058502 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.058498 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:38:47.122740 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.122704 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cc5879d57-2rfbr"] Jun 15 04:38:47.122948 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.122902 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" podUID="65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" containerName="manager" containerID="cri-o://56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19" gracePeriod=30 Jun 15 04:38:47.372113 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.372088 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:47.536952 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.536905 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert\") pod \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " Jun 15 04:38:47.537131 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.537047 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr2v9\" (UniqueName: \"kubernetes.io/projected/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-kube-api-access-jr2v9\") pod \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\" (UID: \"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1\") " Jun 15 04:38:47.539069 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.539034 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" (UID: "65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:38:47.539179 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.539088 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-kube-api-access-jr2v9" (OuterVolumeSpecName: "kube-api-access-jr2v9") pod "65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" (UID: "65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1"). InnerVolumeSpecName "kube-api-access-jr2v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:38:47.637840 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.637753 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr2v9\" (UniqueName: \"kubernetes.io/projected/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-kube-api-access-jr2v9\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:38:47.637840 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:47.637785 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1-webhook-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:38:48.104309 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.104271 2554 generic.go:356] "Generic (PLEG): container finished" podID="65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" containerID="56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19" exitCode=0 Jun 15 04:38:48.104808 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.104319 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" Jun 15 04:38:48.104808 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.104355 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" event={"ID":"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1","Type":"ContainerDied","Data":"56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19"} Jun 15 04:38:48.104808 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.104428 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc5879d57-2rfbr" event={"ID":"65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1","Type":"ContainerDied","Data":"f498840d7d606ef86a7e2fd88bdaec6827e28237b6031ec8a8f96203b89420d4"} Jun 15 04:38:48.104808 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.104451 2554 scope.go:117] "RemoveContainer" containerID="56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19" Jun 15 04:38:48.112915 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.112899 2554 scope.go:117] "RemoveContainer" containerID="56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19" Jun 15 04:38:48.113173 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:38:48.113152 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19\": container with ID starting with 56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19 not found: ID does not exist" containerID="56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19" Jun 15 04:38:48.113222 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.113181 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19"} err="failed to get container status \"56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19\": rpc error: code = NotFound desc = could not find container \"56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19\": container with ID starting with 56afb277384b557875844601a423b9fa4c8a31ebb12aadce91bf079f3e385c19 not found: ID does not exist" Jun 15 04:38:48.120826 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.120796 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cc5879d57-2rfbr"] Jun 15 04:38:48.124080 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:48.124059 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cc5879d57-2rfbr"] Jun 15 04:38:49.828501 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:38:49.828468 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" path="/var/lib/kubelet/pods/65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1/volumes" Jun 15 04:39:07.000454 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:07.000416 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:39:54.327028 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.326990 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6486bf9b9d-49hd4"] Jun 15 04:39:54.327488 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.327327 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" containerName="manager" Jun 15 04:39:54.327488 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.327339 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" containerName="manager" Jun 15 04:39:54.327488 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.327408 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e87a1f-dde6-45e9-bb6d-cd7ebaac17a1" containerName="manager" Jun 15 04:39:54.330375 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.330357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.332930 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.332904 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 04:39:54.336588 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.336558 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6486bf9b9d-49hd4"] Jun 15 04:39:54.456605 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.456576 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b0f4f-def4-438a-b81c-5cc7654d1968-oidc-ca\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.456816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.456646 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bjh6\" (UniqueName: \"kubernetes.io/projected/7c3b0f4f-def4-438a-b81c-5cc7654d1968-kube-api-access-4bjh6\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.456816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.456742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c3b0f4f-def4-438a-b81c-5cc7654d1968-tls-cert\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.558061 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.558018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bjh6\" (UniqueName: \"kubernetes.io/projected/7c3b0f4f-def4-438a-b81c-5cc7654d1968-kube-api-access-4bjh6\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.558271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.558073 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c3b0f4f-def4-438a-b81c-5cc7654d1968-tls-cert\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.558271 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.558154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b0f4f-def4-438a-b81c-5cc7654d1968-oidc-ca\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.558864 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.558840 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b0f4f-def4-438a-b81c-5cc7654d1968-oidc-ca\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.560533 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.560507 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c3b0f4f-def4-438a-b81c-5cc7654d1968-tls-cert\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.566647 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.566621 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bjh6\" (UniqueName: \"kubernetes.io/projected/7c3b0f4f-def4-438a-b81c-5cc7654d1968-kube-api-access-4bjh6\") pod \"authorino-6486bf9b9d-49hd4\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.640748 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.640648 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:39:54.772589 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.772562 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6486bf9b9d-49hd4"] Jun 15 04:39:54.774810 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:39:54.774782 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c3b0f4f_def4_438a_b81c_5cc7654d1968.slice/crio-4f40bbe41e5869c5b4a0c70531311ced8df3cdef94e6d581bcfdfe6ccd161749 WatchSource:0}: Error finding container 4f40bbe41e5869c5b4a0c70531311ced8df3cdef94e6d581bcfdfe6ccd161749: Status 404 returned error can't find the container with id 4f40bbe41e5869c5b4a0c70531311ced8df3cdef94e6d581bcfdfe6ccd161749 Jun 15 04:39:54.776284 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:54.776263 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:39:55.423076 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.423038 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" event={"ID":"7c3b0f4f-def4-438a-b81c-5cc7654d1968","Type":"ContainerStarted","Data":"3f600b7154c643f1a3c06929036304347b9b4016c82e1369b96b714a48f41ebd"} Jun 15 04:39:55.423483 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.423086 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" event={"ID":"7c3b0f4f-def4-438a-b81c-5cc7654d1968","Type":"ContainerStarted","Data":"4f40bbe41e5869c5b4a0c70531311ced8df3cdef94e6d581bcfdfe6ccd161749"} Jun 15 04:39:55.438443 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.438341 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" podStartSLOduration=1.034870591 podStartE2EDuration="1.438323407s" totalImagesPullingTime="403.452816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:39:55.437181275 +0000 UTC m=+868.000476200" watchObservedRunningTime="2026-06-15 04:39:55.438323407 +0000 UTC m=+868.001618330" Jun 15 04:39:55.460912 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.460875 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cbd7b9748-48zmw"] Jun 15 04:39:55.461088 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.461066 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-cbd7b9748-48zmw" podUID="1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" containerName="authorino" containerID="cri-o://9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1" gracePeriod=30 Jun 15 04:39:55.709951 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.709924 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:39:55.869915 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.869872 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrzgb\" (UniqueName: \"kubernetes.io/projected/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-kube-api-access-qrzgb\") pod \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " Jun 15 04:39:55.870120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.869962 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-tls-cert\") pod \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\" (UID: \"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4\") " Jun 15 04:39:55.872052 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.872020 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-kube-api-access-qrzgb" (OuterVolumeSpecName: "kube-api-access-qrzgb") pod "1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" (UID: "1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4"). InnerVolumeSpecName "kube-api-access-qrzgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:39:55.880788 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.880754 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" (UID: "1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:39:55.971565 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.971464 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrzgb\" (UniqueName: \"kubernetes.io/projected/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-kube-api-access-qrzgb\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:39:55.971565 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:55.971510 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4-tls-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:39:56.428766 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.428728 2554 generic.go:356] "Generic (PLEG): container finished" podID="1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" containerID="9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1" exitCode=0 Jun 15 04:39:56.429267 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.428788 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbd7b9748-48zmw" Jun 15 04:39:56.429267 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.428817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbd7b9748-48zmw" event={"ID":"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4","Type":"ContainerDied","Data":"9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1"} Jun 15 04:39:56.429267 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.428874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbd7b9748-48zmw" event={"ID":"1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4","Type":"ContainerDied","Data":"fb9780d1a469925a59857684b784957fa6dda496bfbdb7433e244818dab146c4"} Jun 15 04:39:56.429267 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.428899 2554 scope.go:117] "RemoveContainer" containerID="9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1" Jun 15 04:39:56.437602 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.437581 2554 scope.go:117] "RemoveContainer" containerID="9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1" Jun 15 04:39:56.438004 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:39:56.437986 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1\": container with ID starting with 9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1 not found: ID does not exist" containerID="9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1" Jun 15 04:39:56.438067 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.438014 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1"} err="failed to get container status \"9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1\": rpc error: code = NotFound desc = could not find container \"9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1\": container with ID starting with 9d823eba48074e66ecd00762ed1f6de07dd2fcaf32ab7370a0e38994b04a13e1 not found: ID does not exist" Jun 15 04:39:56.449861 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.449825 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cbd7b9748-48zmw"] Jun 15 04:39:56.453312 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:56.453283 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cbd7b9748-48zmw"] Jun 15 04:39:57.830401 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:39:57.830364 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" path="/var/lib/kubelet/pods/1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4/volumes" Jun 15 04:40:09.592891 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.592786 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l"] Jun 15 04:40:09.593396 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.593190 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" containerName="authorino" Jun 15 04:40:09.593396 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.593209 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" containerName="authorino" Jun 15 04:40:09.593396 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.593291 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fddd1cd-68fe-4b82-a1d2-96c5c7d945a4" containerName="authorino" Jun 15 04:40:09.597661 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.597632 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.601450 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.601417 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cs2fn\"" Jun 15 04:40:09.601816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.601490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 04:40:09.601961 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.601518 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 04:40:09.602037 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.601569 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 04:40:09.608048 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.608023 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l"] Jun 15 04:40:09.700963 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.700921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cebbf6-e633-4132-b241-9cad04759814-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.701147 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.700975 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.701147 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.701024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76gqn\" (UniqueName: \"kubernetes.io/projected/45cebbf6-e633-4132-b241-9cad04759814-kube-api-access-76gqn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.701147 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.701050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.701147 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.701077 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.701279 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.701177 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802097 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802048 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cebbf6-e633-4132-b241-9cad04759814-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802304 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802112 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802304 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76gqn\" (UniqueName: \"kubernetes.io/projected/45cebbf6-e633-4132-b241-9cad04759814-kube-api-access-76gqn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802304 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802179 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802304 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802208 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802304 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802658 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802631 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802786 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802651 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.802786 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.802744 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.804578 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.804555 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cebbf6-e633-4132-b241-9cad04759814-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.804786 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.804766 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cebbf6-e633-4132-b241-9cad04759814-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.810241 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.810214 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76gqn\" (UniqueName: \"kubernetes.io/projected/45cebbf6-e633-4132-b241-9cad04759814-kube-api-access-76gqn\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6799l\" (UID: \"45cebbf6-e633-4132-b241-9cad04759814\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:09.905147 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.905046 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:40:09.910701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:09.910641 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:40:10.065141 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:10.065115 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l"] Jun 15 04:40:10.067657 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:40:10.067621 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cebbf6_e633_4132_b241_9cad04759814.slice/crio-05a0ac7c8bff0bb66449ee89e28dd7c7ac9ccc7ab4293638b20228510936d486 WatchSource:0}: Error finding container 05a0ac7c8bff0bb66449ee89e28dd7c7ac9ccc7ab4293638b20228510936d486: Status 404 returned error can't find the container with id 05a0ac7c8bff0bb66449ee89e28dd7c7ac9ccc7ab4293638b20228510936d486 Jun 15 04:40:10.494374 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:10.494340 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" event={"ID":"45cebbf6-e633-4132-b241-9cad04759814","Type":"ContainerStarted","Data":"05a0ac7c8bff0bb66449ee89e28dd7c7ac9ccc7ab4293638b20228510936d486"} Jun 15 04:40:14.516720 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:14.516658 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" event={"ID":"45cebbf6-e633-4132-b241-9cad04759814","Type":"ContainerStarted","Data":"217240cc6e4927b82ee784bf9b6c1c6c0d4183ed701175a5fddfd04689c39e51"} Jun 15 04:40:27.851530 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:27.851498 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:40:27.852084 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:27.851607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:40:27.859714 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:27.859692 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:40:27.859861 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:27.859767 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:40:32.686787 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:32.686749 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:40:41.788667 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:40:41.788625 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:41:03.591629 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:03.591582 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:41:14.394373 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:14.394333 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:41:17.596554 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.596506 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng"] Jun 15 04:41:17.600394 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.600368 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.602892 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.602873 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 15 04:41:17.606986 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.606961 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng"] Jun 15 04:41:17.733170 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.733133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.733341 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.733249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e851d7fb-0a9d-405d-b8e7-d59015771e28-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.733341 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.733281 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.733341 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.733332 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.733447 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.733370 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.733447 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.733413 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hsq\" (UniqueName: \"kubernetes.io/projected/e851d7fb-0a9d-405d-b8e7-d59015771e28-kube-api-access-g7hsq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834082 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834038 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834252 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hsq\" (UniqueName: \"kubernetes.io/projected/e851d7fb-0a9d-405d-b8e7-d59015771e28-kube-api-access-g7hsq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834351 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834464 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834444 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834535 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e851d7fb-0a9d-405d-b8e7-d59015771e28-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834535 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834643 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834716 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834670 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.834882 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.834857 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.836748 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.836716 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e851d7fb-0a9d-405d-b8e7-d59015771e28-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.837275 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.837259 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e851d7fb-0a9d-405d-b8e7-d59015771e28-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.845305 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.845277 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hsq\" (UniqueName: \"kubernetes.io/projected/e851d7fb-0a9d-405d-b8e7-d59015771e28-kube-api-access-g7hsq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-jdhng\" (UID: \"e851d7fb-0a9d-405d-b8e7-d59015771e28\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:17.911431 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:17.911335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:18.045553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:18.045507 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng"] Jun 15 04:41:18.047404 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:41:18.047376 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode851d7fb_0a9d_405d_b8e7_d59015771e28.slice/crio-93cae2582abb821610f4a56cb0206c4a27b3542469bc7e8feb8b69ffe63bf98f WatchSource:0}: Error finding container 93cae2582abb821610f4a56cb0206c4a27b3542469bc7e8feb8b69ffe63bf98f: Status 404 returned error can't find the container with id 93cae2582abb821610f4a56cb0206c4a27b3542469bc7e8feb8b69ffe63bf98f Jun 15 04:41:18.811824 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:18.811787 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" event={"ID":"e851d7fb-0a9d-405d-b8e7-d59015771e28","Type":"ContainerStarted","Data":"26e2001d826ab8d8133c65d9394722d23d6823408941943ad9792cb683e47aa0"} Jun 15 04:41:18.812238 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:18.811835 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" event={"ID":"e851d7fb-0a9d-405d-b8e7-d59015771e28","Type":"ContainerStarted","Data":"93cae2582abb821610f4a56cb0206c4a27b3542469bc7e8feb8b69ffe63bf98f"} Jun 15 04:41:18.989170 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:18.989131 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:41:19.818215 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:19.818177 2554 generic.go:356] "Generic (PLEG): container finished" podID="e851d7fb-0a9d-405d-b8e7-d59015771e28" containerID="26e2001d826ab8d8133c65d9394722d23d6823408941943ad9792cb683e47aa0" exitCode=0 Jun 15 04:41:19.818726 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:19.818240 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" event={"ID":"e851d7fb-0a9d-405d-b8e7-d59015771e28","Type":"ContainerDied","Data":"26e2001d826ab8d8133c65d9394722d23d6823408941943ad9792cb683e47aa0"} Jun 15 04:41:21.831620 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:21.831582 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" event={"ID":"e851d7fb-0a9d-405d-b8e7-d59015771e28","Type":"ContainerStarted","Data":"98fb220b87d0e21d862890b0a63e6f5df3aca966fa9f7640416d371995819251"} Jun 15 04:41:21.850316 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:21.850263 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" podStartSLOduration=2.391249211 podStartE2EDuration="4.850246671s" totalImagesPullingTime="988.481028ms" totalInitContainerRuntime="1.470516432s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:41:21.848585853 +0000 UTC m=+954.411880802" watchObservedRunningTime="2026-06-15 04:41:21.850246671 +0000 UTC m=+954.413541596" Jun 15 04:41:27.911804 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:27.911763 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:27.912180 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:27.911821 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:27.924430 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:27.924402 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:28.875453 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:28.875424 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-jdhng" Jun 15 04:41:58.000756 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:58.000719 2554 generic.go:356] "Generic (PLEG): container finished" podID="45cebbf6-e633-4132-b241-9cad04759814" containerID="217240cc6e4927b82ee784bf9b6c1c6c0d4183ed701175a5fddfd04689c39e51" exitCode=0 Jun 15 04:41:58.000756 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:58.000759 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" event={"ID":"45cebbf6-e633-4132-b241-9cad04759814","Type":"ContainerDied","Data":"217240cc6e4927b82ee784bf9b6c1c6c0d4183ed701175a5fddfd04689c39e51"} Jun 15 04:41:59.007281 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:59.007244 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" event={"ID":"45cebbf6-e633-4132-b241-9cad04759814","Type":"ContainerStarted","Data":"7daabd54d1705dd5f551426077db4c8051143525bbd18a591df1b8327b555436"} Jun 15 04:41:59.026031 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:59.025982 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" podStartSLOduration=2.881835349 podStartE2EDuration="1m50.025967933s" totalImagesPullingTime="3.721634731s" totalInitContainerRuntime="1m43.422497853s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:40:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:41:59.025089247 +0000 UTC m=+991.588384206" watchObservedRunningTime="2026-06-15 04:41:59.025967933 +0000 UTC m=+991.589262857" Jun 15 04:41:59.911298 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:59.911259 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:41:59.911485 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:59.911327 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:41:59.923823 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:41:59.923791 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:42:00.022969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:00.022938 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6799l" Jun 15 04:42:29.985348 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:29.985315 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6486bf9b9d-49hd4"] Jun 15 04:42:29.985942 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:29.985525 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" podUID="7c3b0f4f-def4-438a-b81c-5cc7654d1968" containerName="authorino" containerID="cri-o://3f600b7154c643f1a3c06929036304347b9b4016c82e1369b96b714a48f41ebd" gracePeriod=30 Jun 15 04:42:30.150473 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.150433 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c3b0f4f-def4-438a-b81c-5cc7654d1968" containerID="3f600b7154c643f1a3c06929036304347b9b4016c82e1369b96b714a48f41ebd" exitCode=0 Jun 15 04:42:30.150633 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.150502 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" event={"ID":"7c3b0f4f-def4-438a-b81c-5cc7654d1968","Type":"ContainerDied","Data":"3f600b7154c643f1a3c06929036304347b9b4016c82e1369b96b714a48f41ebd"} Jun 15 04:42:30.243179 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.243117 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:42:30.317802 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.317766 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c3b0f4f-def4-438a-b81c-5cc7654d1968-tls-cert\") pod \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " Jun 15 04:42:30.318019 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.317838 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b0f4f-def4-438a-b81c-5cc7654d1968-oidc-ca\") pod \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " Jun 15 04:42:30.318019 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.317875 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bjh6\" (UniqueName: \"kubernetes.io/projected/7c3b0f4f-def4-438a-b81c-5cc7654d1968-kube-api-access-4bjh6\") pod \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\" (UID: \"7c3b0f4f-def4-438a-b81c-5cc7654d1968\") " Jun 15 04:42:30.319878 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.319839 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c3b0f4f-def4-438a-b81c-5cc7654d1968-kube-api-access-4bjh6" (OuterVolumeSpecName: "kube-api-access-4bjh6") pod "7c3b0f4f-def4-438a-b81c-5cc7654d1968" (UID: "7c3b0f4f-def4-438a-b81c-5cc7654d1968"). InnerVolumeSpecName "kube-api-access-4bjh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:42:30.322686 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.322644 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c3b0f4f-def4-438a-b81c-5cc7654d1968-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "7c3b0f4f-def4-438a-b81c-5cc7654d1968" (UID: "7c3b0f4f-def4-438a-b81c-5cc7654d1968"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:42:30.327640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.327616 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c3b0f4f-def4-438a-b81c-5cc7654d1968-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7c3b0f4f-def4-438a-b81c-5cc7654d1968" (UID: "7c3b0f4f-def4-438a-b81c-5cc7654d1968"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:42:30.418969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.418935 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c3b0f4f-def4-438a-b81c-5cc7654d1968-tls-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:42:30.418969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.418966 2554 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7c3b0f4f-def4-438a-b81c-5cc7654d1968-oidc-ca\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:42:30.418969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:30.418977 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bjh6\" (UniqueName: \"kubernetes.io/projected/7c3b0f4f-def4-438a-b81c-5cc7654d1968-kube-api-access-4bjh6\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:42:31.156083 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:31.156051 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" Jun 15 04:42:31.156083 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:31.156057 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6486bf9b9d-49hd4" event={"ID":"7c3b0f4f-def4-438a-b81c-5cc7654d1968","Type":"ContainerDied","Data":"4f40bbe41e5869c5b4a0c70531311ced8df3cdef94e6d581bcfdfe6ccd161749"} Jun 15 04:42:31.156652 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:31.156124 2554 scope.go:117] "RemoveContainer" containerID="3f600b7154c643f1a3c06929036304347b9b4016c82e1369b96b714a48f41ebd" Jun 15 04:42:31.176400 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:31.176368 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6486bf9b9d-49hd4"] Jun 15 04:42:31.179169 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:31.179145 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6486bf9b9d-49hd4"] Jun 15 04:42:31.829162 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:31.829122 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c3b0f4f-def4-438a-b81c-5cc7654d1968" path="/var/lib/kubelet/pods/7c3b0f4f-def4-438a-b81c-5cc7654d1968/volumes" Jun 15 04:42:35.560805 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.560768 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-95596b4f9-m8rhp"] Jun 15 04:42:35.561205 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.561118 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c3b0f4f-def4-438a-b81c-5cc7654d1968" containerName="authorino" Jun 15 04:42:35.561205 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.561129 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c3b0f4f-def4-438a-b81c-5cc7654d1968" containerName="authorino" Jun 15 04:42:35.561205 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.561195 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c3b0f4f-def4-438a-b81c-5cc7654d1968" containerName="authorino" Jun 15 04:42:35.565558 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.565527 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:35.574293 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.574266 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95596b4f9-m8rhp"] Jun 15 04:42:35.666981 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.666945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c836f304-f446-4fc0-a077-042d9b507e32-webhook-cert\") pod \"maas-controller-95596b4f9-m8rhp\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:35.667187 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.667000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjftg\" (UniqueName: \"kubernetes.io/projected/c836f304-f446-4fc0-a077-042d9b507e32-kube-api-access-mjftg\") pod \"maas-controller-95596b4f9-m8rhp\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:35.768604 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.768565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c836f304-f446-4fc0-a077-042d9b507e32-webhook-cert\") pod \"maas-controller-95596b4f9-m8rhp\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:35.768604 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.768609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjftg\" (UniqueName: \"kubernetes.io/projected/c836f304-f446-4fc0-a077-042d9b507e32-kube-api-access-mjftg\") pod \"maas-controller-95596b4f9-m8rhp\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:35.771175 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.771149 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c836f304-f446-4fc0-a077-042d9b507e32-webhook-cert\") pod \"maas-controller-95596b4f9-m8rhp\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:35.776337 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.776312 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjftg\" (UniqueName: \"kubernetes.io/projected/c836f304-f446-4fc0-a077-042d9b507e32-kube-api-access-mjftg\") pod \"maas-controller-95596b4f9-m8rhp\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:35.877329 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:35.877244 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:36.012936 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:36.012903 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95596b4f9-m8rhp"] Jun 15 04:42:36.014031 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:42:36.013990 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc836f304_f446_4fc0_a077_042d9b507e32.slice/crio-d5c37bce01549f866752c7a1c67eb3985d62c589ae0bbad3384776e7069ea95a WatchSource:0}: Error finding container d5c37bce01549f866752c7a1c67eb3985d62c589ae0bbad3384776e7069ea95a: Status 404 returned error can't find the container with id d5c37bce01549f866752c7a1c67eb3985d62c589ae0bbad3384776e7069ea95a Jun 15 04:42:36.182422 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:36.182331 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95596b4f9-m8rhp" event={"ID":"c836f304-f446-4fc0-a077-042d9b507e32","Type":"ContainerStarted","Data":"d5c37bce01549f866752c7a1c67eb3985d62c589ae0bbad3384776e7069ea95a"} Jun 15 04:42:37.188483 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:37.188438 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95596b4f9-m8rhp" event={"ID":"c836f304-f446-4fc0-a077-042d9b507e32","Type":"ContainerStarted","Data":"17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6"} Jun 15 04:42:37.188931 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:37.188611 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:37.205452 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:37.205399 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-95596b4f9-m8rhp" podStartSLOduration=1.826094334 podStartE2EDuration="2.205382884s" totalImagesPullingTime="379.28855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:42:37.204461351 +0000 UTC m=+1029.767756276" watchObservedRunningTime="2026-06-15 04:42:37.205382884 +0000 UTC m=+1029.768677807" Jun 15 04:42:48.198701 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.198643 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:42:48.232875 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.232836 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79cf7bb55f-48vcl"] Jun 15 04:42:48.233124 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.233092 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" podUID="27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" containerName="manager" containerID="cri-o://83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943" gracePeriod=30 Jun 15 04:42:48.481588 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.481559 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:42:48.589440 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.589407 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-webhook-cert\") pod \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " Jun 15 04:42:48.589738 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.589464 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6z5p\" (UniqueName: \"kubernetes.io/projected/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-kube-api-access-z6z5p\") pod \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\" (UID: \"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f\") " Jun 15 04:42:48.591596 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.591571 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" (UID: "27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:42:48.591694 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.591654 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-kube-api-access-z6z5p" (OuterVolumeSpecName: "kube-api-access-z6z5p") pod "27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" (UID: "27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f"). InnerVolumeSpecName "kube-api-access-z6z5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:42:48.690902 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.690860 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-webhook-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:42:48.690902 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:48.690895 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6z5p\" (UniqueName: \"kubernetes.io/projected/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f-kube-api-access-z6z5p\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:42:49.246718 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.246664 2554 generic.go:356] "Generic (PLEG): container finished" podID="27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" containerID="83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943" exitCode=0 Jun 15 04:42:49.247217 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.246743 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" Jun 15 04:42:49.247217 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.246752 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" event={"ID":"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f","Type":"ContainerDied","Data":"83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943"} Jun 15 04:42:49.247217 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.246810 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79cf7bb55f-48vcl" event={"ID":"27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f","Type":"ContainerDied","Data":"945944aaec68f6cbebd843dc89feaa3a251ae2de06caaed20d8bb1c94dd05447"} Jun 15 04:42:49.247217 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.246833 2554 scope.go:117] "RemoveContainer" containerID="83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943" Jun 15 04:42:49.256050 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.256033 2554 scope.go:117] "RemoveContainer" containerID="83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943" Jun 15 04:42:49.256353 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:42:49.256319 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943\": container with ID starting with 83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943 not found: ID does not exist" containerID="83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943" Jun 15 04:42:49.256456 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.256358 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943"} err="failed to get container status \"83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943\": rpc error: code = NotFound desc = could not find container \"83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943\": container with ID starting with 83ec997b75a78b4fa8f01d92457fcbe48dda9bbb212e3ba4ec7eda64363aa943 not found: ID does not exist" Jun 15 04:42:49.269708 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.269660 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79cf7bb55f-48vcl"] Jun 15 04:42:49.271957 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.271931 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79cf7bb55f-48vcl"] Jun 15 04:42:49.829421 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:42:49.829383 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" path="/var/lib/kubelet/pods/27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f/volumes" Jun 15 04:43:19.081333 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:43:19.081298 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:43:28.293089 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:43:28.293054 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:43:37.794175 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:43:37.794134 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:43:47.888120 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:43:47.888082 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:43:57.688425 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:43:57.688391 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:44:07.391072 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:07.391029 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:44:14.579201 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:14.579163 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95596b4f9-m8rhp"] Jun 15 04:44:14.579632 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:14.579351 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-95596b4f9-m8rhp" podUID="c836f304-f446-4fc0-a077-042d9b507e32" containerName="manager" containerID="cri-o://17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6" gracePeriod=30 Jun 15 04:44:14.830730 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:14.830644 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:44:14.976579 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:14.976545 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c836f304-f446-4fc0-a077-042d9b507e32-webhook-cert\") pod \"c836f304-f446-4fc0-a077-042d9b507e32\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " Jun 15 04:44:14.976799 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:14.976652 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjftg\" (UniqueName: \"kubernetes.io/projected/c836f304-f446-4fc0-a077-042d9b507e32-kube-api-access-mjftg\") pod \"c836f304-f446-4fc0-a077-042d9b507e32\" (UID: \"c836f304-f446-4fc0-a077-042d9b507e32\") " Jun 15 04:44:14.978757 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:14.978732 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c836f304-f446-4fc0-a077-042d9b507e32-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c836f304-f446-4fc0-a077-042d9b507e32" (UID: "c836f304-f446-4fc0-a077-042d9b507e32"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:44:14.978925 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:14.978901 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c836f304-f446-4fc0-a077-042d9b507e32-kube-api-access-mjftg" (OuterVolumeSpecName: "kube-api-access-mjftg") pod "c836f304-f446-4fc0-a077-042d9b507e32" (UID: "c836f304-f446-4fc0-a077-042d9b507e32"). InnerVolumeSpecName "kube-api-access-mjftg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:44:15.077938 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.077897 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjftg\" (UniqueName: \"kubernetes.io/projected/c836f304-f446-4fc0-a077-042d9b507e32-kube-api-access-mjftg\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:44:15.077938 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.077930 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c836f304-f446-4fc0-a077-042d9b507e32-webhook-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:44:15.667720 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.667666 2554 generic.go:356] "Generic (PLEG): container finished" podID="c836f304-f446-4fc0-a077-042d9b507e32" containerID="17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6" exitCode=0 Jun 15 04:44:15.668169 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.667730 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95596b4f9-m8rhp" Jun 15 04:44:15.668169 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.667764 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95596b4f9-m8rhp" event={"ID":"c836f304-f446-4fc0-a077-042d9b507e32","Type":"ContainerDied","Data":"17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6"} Jun 15 04:44:15.668169 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.667833 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95596b4f9-m8rhp" event={"ID":"c836f304-f446-4fc0-a077-042d9b507e32","Type":"ContainerDied","Data":"d5c37bce01549f866752c7a1c67eb3985d62c589ae0bbad3384776e7069ea95a"} Jun 15 04:44:15.668169 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.667853 2554 scope.go:117] "RemoveContainer" containerID="17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6" Jun 15 04:44:15.677340 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.677324 2554 scope.go:117] "RemoveContainer" containerID="17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6" Jun 15 04:44:15.677603 ip-10-0-136-236 kubenswrapper[2554]: E0615 04:44:15.677583 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6\": container with ID starting with 17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6 not found: ID does not exist" containerID="17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6" Jun 15 04:44:15.677647 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.677615 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6"} err="failed to get container status \"17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6\": rpc error: code = NotFound desc = could not find container \"17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6\": container with ID starting with 17904a82b75d937a42013a11aeb8a4dd9c467498fd1a36836053b5b01446f2f6 not found: ID does not exist" Jun 15 04:44:15.692534 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.692504 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95596b4f9-m8rhp"] Jun 15 04:44:15.694057 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.694039 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-95596b4f9-m8rhp"] Jun 15 04:44:15.829484 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:15.829449 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c836f304-f446-4fc0-a077-042d9b507e32" path="/var/lib/kubelet/pods/c836f304-f446-4fc0-a077-042d9b507e32/volumes" Jun 15 04:44:16.445795 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.445757 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-95596b4f9-jzm74"] Jun 15 04:44:16.446128 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.446115 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c836f304-f446-4fc0-a077-042d9b507e32" containerName="manager" Jun 15 04:44:16.446173 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.446130 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c836f304-f446-4fc0-a077-042d9b507e32" containerName="manager" Jun 15 04:44:16.446173 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.446159 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" containerName="manager" Jun 15 04:44:16.446173 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.446166 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" containerName="manager" Jun 15 04:44:16.446275 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.446232 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b5bce6-c7ab-4fd8-a5fc-3ac6f8bc103f" containerName="manager" Jun 15 04:44:16.446275 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.446242 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c836f304-f446-4fc0-a077-042d9b507e32" containerName="manager" Jun 15 04:44:16.450583 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.450562 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.454609 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.454585 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 04:44:16.454871 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.454845 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 04:44:16.455038 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.454622 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nrssn\"" Jun 15 04:44:16.455936 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.455916 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95596b4f9-jzm74"] Jun 15 04:44:16.592920 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.592882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abc516ee-293d-480e-b449-207e7ea51f17-webhook-cert\") pod \"maas-controller-95596b4f9-jzm74\" (UID: \"abc516ee-293d-480e-b449-207e7ea51f17\") " pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.593099 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.592979 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm9cn\" (UniqueName: \"kubernetes.io/projected/abc516ee-293d-480e-b449-207e7ea51f17-kube-api-access-fm9cn\") pod \"maas-controller-95596b4f9-jzm74\" (UID: \"abc516ee-293d-480e-b449-207e7ea51f17\") " pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.694451 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.694415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm9cn\" (UniqueName: \"kubernetes.io/projected/abc516ee-293d-480e-b449-207e7ea51f17-kube-api-access-fm9cn\") pod \"maas-controller-95596b4f9-jzm74\" (UID: \"abc516ee-293d-480e-b449-207e7ea51f17\") " pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.694902 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.694511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abc516ee-293d-480e-b449-207e7ea51f17-webhook-cert\") pod \"maas-controller-95596b4f9-jzm74\" (UID: \"abc516ee-293d-480e-b449-207e7ea51f17\") " pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.697075 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.697012 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abc516ee-293d-480e-b449-207e7ea51f17-webhook-cert\") pod \"maas-controller-95596b4f9-jzm74\" (UID: \"abc516ee-293d-480e-b449-207e7ea51f17\") " pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.702061 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.702034 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm9cn\" (UniqueName: \"kubernetes.io/projected/abc516ee-293d-480e-b449-207e7ea51f17-kube-api-access-fm9cn\") pod \"maas-controller-95596b4f9-jzm74\" (UID: \"abc516ee-293d-480e-b449-207e7ea51f17\") " pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.762313 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.762270 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:16.892980 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:16.892955 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95596b4f9-jzm74"] Jun 15 04:44:16.895096 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:44:16.895059 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc516ee_293d_480e_b449_207e7ea51f17.slice/crio-7e28133e86cbfa3abf7d18bf3ff5a627a01d6c58afe400223fb5c92da76e1517 WatchSource:0}: Error finding container 7e28133e86cbfa3abf7d18bf3ff5a627a01d6c58afe400223fb5c92da76e1517: Status 404 returned error can't find the container with id 7e28133e86cbfa3abf7d18bf3ff5a627a01d6c58afe400223fb5c92da76e1517 Jun 15 04:44:17.679802 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:17.679765 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95596b4f9-jzm74" event={"ID":"abc516ee-293d-480e-b449-207e7ea51f17","Type":"ContainerStarted","Data":"42ee0307ba3bc8a2672bd6a2213d5bf4d5e2770dfe21383f2d608db7f9d5b4f7"} Jun 15 04:44:17.680026 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:17.679826 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95596b4f9-jzm74" event={"ID":"abc516ee-293d-480e-b449-207e7ea51f17","Type":"ContainerStarted","Data":"7e28133e86cbfa3abf7d18bf3ff5a627a01d6c58afe400223fb5c92da76e1517"} Jun 15 04:44:17.680026 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:17.679862 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:17.696313 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:17.696264 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-95596b4f9-jzm74" podStartSLOduration=1.331687892 podStartE2EDuration="1.696249856s" totalImagesPullingTime="364.561964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:44:17.695181882 +0000 UTC m=+1130.258476825" watchObservedRunningTime="2026-06-15 04:44:17.696249856 +0000 UTC m=+1130.259544780" Jun 15 04:44:28.689857 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:28.689817 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-95596b4f9-jzm74" Jun 15 04:44:40.188434 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:40.188352 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:44:43.887532 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:44:43.887494 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:45:00.138640 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.138606 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691645-s2vrd"] Jun 15 04:45:00.142098 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.142081 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" Jun 15 04:45:00.144875 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.144847 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qnsvr\"" Jun 15 04:45:00.153866 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.153828 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691645-s2vrd"] Jun 15 04:45:00.286065 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.286024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncr8b\" (UniqueName: \"kubernetes.io/projected/0f6ea354-ac53-4b24-9600-0626aa5fdb49-kube-api-access-ncr8b\") pod \"maas-api-key-cleanup-29691645-s2vrd\" (UID: \"0f6ea354-ac53-4b24-9600-0626aa5fdb49\") " pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" Jun 15 04:45:00.387276 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.387234 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncr8b\" (UniqueName: \"kubernetes.io/projected/0f6ea354-ac53-4b24-9600-0626aa5fdb49-kube-api-access-ncr8b\") pod \"maas-api-key-cleanup-29691645-s2vrd\" (UID: \"0f6ea354-ac53-4b24-9600-0626aa5fdb49\") " pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" Jun 15 04:45:00.395854 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.395770 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncr8b\" (UniqueName: \"kubernetes.io/projected/0f6ea354-ac53-4b24-9600-0626aa5fdb49-kube-api-access-ncr8b\") pod \"maas-api-key-cleanup-29691645-s2vrd\" (UID: \"0f6ea354-ac53-4b24-9600-0626aa5fdb49\") " pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" Jun 15 04:45:00.460516 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.460477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" Jun 15 04:45:00.592371 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.592338 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691645-s2vrd"] Jun 15 04:45:00.593455 ip-10-0-136-236 kubenswrapper[2554]: W0615 04:45:00.593429 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6ea354_ac53_4b24_9600_0626aa5fdb49.slice/crio-ba69782890e9a28ea5332050e543ae367ea6bce85e9d1375c4a2d9198f9673ab WatchSource:0}: Error finding container ba69782890e9a28ea5332050e543ae367ea6bce85e9d1375c4a2d9198f9673ab: Status 404 returned error can't find the container with id ba69782890e9a28ea5332050e543ae367ea6bce85e9d1375c4a2d9198f9673ab Jun 15 04:45:00.595391 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.595376 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:45:00.890098 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:00.890055 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" event={"ID":"0f6ea354-ac53-4b24-9600-0626aa5fdb49","Type":"ContainerStarted","Data":"ba69782890e9a28ea5332050e543ae367ea6bce85e9d1375c4a2d9198f9673ab"} Jun 15 04:45:03.906723 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:03.906664 2554 generic.go:356] "Generic (PLEG): container finished" podID="0f6ea354-ac53-4b24-9600-0626aa5fdb49" containerID="d66c75b9ce07cde42fdad76fed1077daf6350db3aefc0ac364deda4e0af19be5" exitCode=0 Jun 15 04:45:03.907135 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:03.906720 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" event={"ID":"0f6ea354-ac53-4b24-9600-0626aa5fdb49","Type":"ContainerDied","Data":"d66c75b9ce07cde42fdad76fed1077daf6350db3aefc0ac364deda4e0af19be5"} Jun 15 04:45:05.044603 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:05.044573 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" Jun 15 04:45:05.133655 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:05.133613 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncr8b\" (UniqueName: \"kubernetes.io/projected/0f6ea354-ac53-4b24-9600-0626aa5fdb49-kube-api-access-ncr8b\") pod \"0f6ea354-ac53-4b24-9600-0626aa5fdb49\" (UID: \"0f6ea354-ac53-4b24-9600-0626aa5fdb49\") " Jun 15 04:45:05.135780 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:05.135759 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6ea354-ac53-4b24-9600-0626aa5fdb49-kube-api-access-ncr8b" (OuterVolumeSpecName: "kube-api-access-ncr8b") pod "0f6ea354-ac53-4b24-9600-0626aa5fdb49" (UID: "0f6ea354-ac53-4b24-9600-0626aa5fdb49"). InnerVolumeSpecName "kube-api-access-ncr8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:45:05.234470 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:05.234378 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncr8b\" (UniqueName: \"kubernetes.io/projected/0f6ea354-ac53-4b24-9600-0626aa5fdb49-kube-api-access-ncr8b\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 04:45:05.918229 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:05.918195 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" Jun 15 04:45:05.918229 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:05.918204 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691645-s2vrd" event={"ID":"0f6ea354-ac53-4b24-9600-0626aa5fdb49","Type":"ContainerDied","Data":"ba69782890e9a28ea5332050e543ae367ea6bce85e9d1375c4a2d9198f9673ab"} Jun 15 04:45:05.918438 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:05.918252 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba69782890e9a28ea5332050e543ae367ea6bce85e9d1375c4a2d9198f9673ab" Jun 15 04:45:08.690187 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:08.690152 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:45:12.888298 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:12.888259 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:45:27.881618 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:27.881588 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:45:27.883659 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:27.883634 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:45:27.889853 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:27.889831 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:45:27.891610 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:27.891592 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:45:34.083852 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:34.083816 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:45:43.084816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:43.084776 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:45:59.884524 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:45:59.884484 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:46:08.186204 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:46:08.186158 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:46:25.689553 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:46:25.689508 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:46:34.489304 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:46:34.489266 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:47:06.486565 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:47:06.486526 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:47:15.190539 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:47:15.190497 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:47:23.984110 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:47:23.984074 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:47:31.791099 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:47:31.791057 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:47:40.290287 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:47:40.290199 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:47:48.888259 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:47:48.888223 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:47:52.694883 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:47:52.694842 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:48:05.888519 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:48:05.888482 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:48:20.187122 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:48:20.187081 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:49:08.086973 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:49:08.086938 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:49:15.083388 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:49:15.083302 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:49:33.489977 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:49:33.489936 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:49:38.294229 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:49:38.294187 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:49:42.484826 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:49:42.484787 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:49:52.891847 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:49:52.891809 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:50:00.294016 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:00.293981 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:50:10.692400 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:10.692364 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:50:18.092250 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:18.092208 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:50:27.917949 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:27.917920 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:50:27.921743 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:27.921723 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:50:27.926103 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:27.926079 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:50:27.929436 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:27.929418 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:50:27.995376 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:27.995339 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:50:35.492457 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:35.492417 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:50:43.898969 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:43.898881 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:50:52.183937 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:50:52.183892 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:53:16.689230 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:53:16.689190 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:53:21.488930 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:53:21.488888 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:53:48.092949 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:53:48.092854 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:53:51.588268 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:53:51.588222 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:54:02.396207 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:54:02.396171 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:54:11.893369 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:54:11.893330 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:54:21.693264 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:54:21.693229 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:54:31.798757 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:54:31.798712 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:54:41.384906 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:54:41.384873 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:54:50.686887 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:54:50.686846 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:55:00.692585 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:00.692542 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:55:10.195756 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:10.195656 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:55:19.191083 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:19.191040 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:55:23.597075 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:23.597040 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:55:27.948526 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:27.948494 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:55:27.952568 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:27.952543 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 04:55:27.956248 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:27.956226 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:55:27.960374 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:27.960356 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 04:55:51.984213 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:55:51.984181 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:56:36.382460 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:56:36.382422 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:56:44.284976 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:56:44.284891 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:56:53.683022 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:56:53.682985 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:57:01.488607 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:57:01.488570 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:57:10.781429 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:57:10.781392 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:57:22.293779 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:57:22.293742 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:57:32.290976 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:57:32.290939 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:57:36.796816 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:57:36.796777 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:57:44.790518 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:57:44.790479 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:57:52.286533 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:57:52.286493 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:58:00.191227 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:58:00.191196 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:58:10.882272 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:58:10.882174 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:58:30.088125 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:58:30.088083 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:58:37.587846 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:58:37.587808 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:58:47.200533 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:58:47.200488 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:58:53.894102 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:58:53.894062 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:59:12.692176 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:59:12.692141 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:59:20.189950 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:59:20.189913 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:59:29.985147 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:59:29.985110 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:59:36.494253 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:59:36.494219 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:59:47.395093 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:59:47.394997 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 04:59:55.292956 ip-10-0-136-236 kubenswrapper[2554]: I0615 04:59:55.292917 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:00:00.137192 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.137157 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691660-sn7fw"] Jun 15 05:00:00.137611 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.137499 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6ea354-ac53-4b24-9600-0626aa5fdb49" containerName="cleanup" Jun 15 05:00:00.137611 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.137511 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6ea354-ac53-4b24-9600-0626aa5fdb49" containerName="cleanup" Jun 15 05:00:00.137611 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.137592 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6ea354-ac53-4b24-9600-0626aa5fdb49" containerName="cleanup" Jun 15 05:00:00.140602 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.140586 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" Jun 15 05:00:00.143084 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.143064 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qnsvr\"" Jun 15 05:00:00.154181 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.154153 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691660-sn7fw"] Jun 15 05:00:00.228127 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.228098 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flnt4\" (UniqueName: \"kubernetes.io/projected/605424c6-a50d-4896-ad3c-f3f75c22caf8-kube-api-access-flnt4\") pod \"maas-api-key-cleanup-29691660-sn7fw\" (UID: \"605424c6-a50d-4896-ad3c-f3f75c22caf8\") " pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" Jun 15 05:00:00.329090 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.329053 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flnt4\" (UniqueName: \"kubernetes.io/projected/605424c6-a50d-4896-ad3c-f3f75c22caf8-kube-api-access-flnt4\") pod \"maas-api-key-cleanup-29691660-sn7fw\" (UID: \"605424c6-a50d-4896-ad3c-f3f75c22caf8\") " pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" Jun 15 05:00:00.337797 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.337764 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flnt4\" (UniqueName: \"kubernetes.io/projected/605424c6-a50d-4896-ad3c-f3f75c22caf8-kube-api-access-flnt4\") pod \"maas-api-key-cleanup-29691660-sn7fw\" (UID: \"605424c6-a50d-4896-ad3c-f3f75c22caf8\") " pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" Jun 15 05:00:00.450536 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.450436 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" Jun 15 05:00:00.578804 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:00.578774 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691660-sn7fw"] Jun 15 05:00:00.580021 ip-10-0-136-236 kubenswrapper[2554]: W0615 05:00:00.579986 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605424c6_a50d_4896_ad3c_f3f75c22caf8.slice/crio-a53406bda355342d7b5be894d9db0b3507cab637ab3b2768f06ec122115f2935 WatchSource:0}: Error finding container a53406bda355342d7b5be894d9db0b3507cab637ab3b2768f06ec122115f2935: Status 404 returned error can't find the container with id a53406bda355342d7b5be894d9db0b3507cab637ab3b2768f06ec122115f2935 Jun 15 05:00:01.102984 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:01.102945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" event={"ID":"605424c6-a50d-4896-ad3c-f3f75c22caf8","Type":"ContainerStarted","Data":"08d4b475c3c33e9605f2fb18b57520bce0dcf078ea89f7894dc48c63aad42dd9"} Jun 15 05:00:01.103169 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:01.103001 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" event={"ID":"605424c6-a50d-4896-ad3c-f3f75c22caf8","Type":"ContainerStarted","Data":"a53406bda355342d7b5be894d9db0b3507cab637ab3b2768f06ec122115f2935"} Jun 15 05:00:01.118309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:01.118256 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" podStartSLOduration=1.118239921 podStartE2EDuration="1.118239921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:00:01.116906344 +0000 UTC m=+2073.680201288" watchObservedRunningTime="2026-06-15 05:00:01.118239921 +0000 UTC m=+2073.681534844" Jun 15 05:00:02.108884 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:02.108847 2554 generic.go:356] "Generic (PLEG): container finished" podID="605424c6-a50d-4896-ad3c-f3f75c22caf8" containerID="08d4b475c3c33e9605f2fb18b57520bce0dcf078ea89f7894dc48c63aad42dd9" exitCode=0 Jun 15 05:00:02.109276 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:02.108917 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" event={"ID":"605424c6-a50d-4896-ad3c-f3f75c22caf8","Type":"ContainerDied","Data":"08d4b475c3c33e9605f2fb18b57520bce0dcf078ea89f7894dc48c63aad42dd9"} Jun 15 05:00:03.246073 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:03.246045 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" Jun 15 05:00:03.360039 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:03.359998 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flnt4\" (UniqueName: \"kubernetes.io/projected/605424c6-a50d-4896-ad3c-f3f75c22caf8-kube-api-access-flnt4\") pod \"605424c6-a50d-4896-ad3c-f3f75c22caf8\" (UID: \"605424c6-a50d-4896-ad3c-f3f75c22caf8\") " Jun 15 05:00:03.362139 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:03.362112 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/605424c6-a50d-4896-ad3c-f3f75c22caf8-kube-api-access-flnt4" (OuterVolumeSpecName: "kube-api-access-flnt4") pod "605424c6-a50d-4896-ad3c-f3f75c22caf8" (UID: "605424c6-a50d-4896-ad3c-f3f75c22caf8"). InnerVolumeSpecName "kube-api-access-flnt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:00:03.461585 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:03.461543 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flnt4\" (UniqueName: \"kubernetes.io/projected/605424c6-a50d-4896-ad3c-f3f75c22caf8-kube-api-access-flnt4\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:00:04.119299 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:04.119218 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" Jun 15 05:00:04.119299 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:04.119229 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691660-sn7fw" event={"ID":"605424c6-a50d-4896-ad3c-f3f75c22caf8","Type":"ContainerDied","Data":"a53406bda355342d7b5be894d9db0b3507cab637ab3b2768f06ec122115f2935"} Jun 15 05:00:04.119299 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:04.119273 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a53406bda355342d7b5be894d9db0b3507cab637ab3b2768f06ec122115f2935" Jun 15 05:00:05.382074 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:05.382041 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:00:16.891290 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:16.891248 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:00:27.204244 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:27.204206 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:00:27.979522 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:27.979492 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 05:00:27.984461 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:27.984437 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 05:00:27.990081 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:27.990056 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 05:00:27.995379 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:27.995352 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 05:00:39.189620 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:39.189582 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:00:49.690355 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:49.690316 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:00:54.192627 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:00:54.192587 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:01:02.185440 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:01:02.185402 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:01:06.803473 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:01:06.803435 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:01:21.083932 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:01:21.083841 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:01:30.084690 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:01:30.084635 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:01:39.389762 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:01:39.389720 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:01:45.590730 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:01:45.590692 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:02:07.195328 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:07.195291 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:02:19.490496 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:19.490461 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:02:20.354406 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.354371 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6"] Jun 15 05:02:20.354775 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.354758 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="605424c6-a50d-4896-ad3c-f3f75c22caf8" containerName="cleanup" Jun 15 05:02:20.354775 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.354774 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="605424c6-a50d-4896-ad3c-f3f75c22caf8" containerName="cleanup" Jun 15 05:02:20.354940 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.354840 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="605424c6-a50d-4896-ad3c-f3f75c22caf8" containerName="cleanup" Jun 15 05:02:20.357939 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.357914 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.360720 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.360698 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9984d613-openshift-default-dockercfg-8hn7d\"" Jun 15 05:02:20.360855 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.360733 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 05:02:20.374861 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.374833 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6"] Jun 15 05:02:20.411742 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.411708 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-podinfo\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.411914 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.411789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-data\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.411914 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.411812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-socket\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.411914 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.411838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-credential-socket\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.411914 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.411888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-certs\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.411914 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.411910 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-envoy\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.412118 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.411977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-token\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.412118 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.412006 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghsw\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-kube-api-access-vghsw\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.412118 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.412046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istiod-ca-cert\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513333 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-podinfo\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513369 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-data\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-socket\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-credential-socket\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-certs\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-envoy\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513556 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-token\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghsw\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-kube-api-access-vghsw\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.513862 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.513641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istiod-ca-cert\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.514481 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.514458 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istiod-ca-cert\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.514640 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.514607 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-data\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.514923 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.514892 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-credential-socket\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.515043 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.514928 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-certs\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.515043 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.515026 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-socket\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.516221 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.516202 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-podinfo\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.516535 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.516513 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-envoy\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.533006 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.532985 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-token\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.533378 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.533355 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghsw\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-kube-api-access-vghsw\") pod \"e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.668462 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.668373 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:20.811924 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.811895 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6"] Jun 15 05:02:20.815956 ip-10-0-136-236 kubenswrapper[2554]: W0615 05:02:20.815929 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884a2fc5_d2f8_43ae_bb3b_afcf67c4c50a.slice/crio-ecad77ef51bb4513c44bd6dca2f68853a422b975c1582a75cf87d97920dd084c WatchSource:0}: Error finding container ecad77ef51bb4513c44bd6dca2f68853a422b975c1582a75cf87d97920dd084c: Status 404 returned error can't find the container with id ecad77ef51bb4513c44bd6dca2f68853a422b975c1582a75cf87d97920dd084c Jun 15 05:02:20.817668 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:20.817647 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 05:02:21.778463 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:21.778412 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" event={"ID":"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a","Type":"ContainerStarted","Data":"ecad77ef51bb4513c44bd6dca2f68853a422b975c1582a75cf87d97920dd084c"} Jun 15 05:02:23.104227 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:23.104188 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:23.104493 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:23.104263 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:23.104493 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:23.104295 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:23.791792 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:23.791757 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" event={"ID":"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a","Type":"ContainerStarted","Data":"7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f"} Jun 15 05:02:23.811194 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:23.811150 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" podStartSLOduration=1.525045445 podStartE2EDuration="3.811135898s" totalImagesPullingTime="2.286090453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:02:23.809944085 +0000 UTC m=+2216.373239070" watchObservedRunningTime="2026-06-15 05:02:23.811135898 +0000 UTC m=+2216.374430821" Jun 15 05:02:24.669267 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:24.669226 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:24.674505 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:24.674478 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:24.796344 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:24.796317 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:24.797255 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:24.797236 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:26.869790 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:26.869756 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6"] Jun 15 05:02:27.810523 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:27.810468 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" podUID="884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" containerName="istio-proxy" containerID="cri-o://7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f" gracePeriod=30 Jun 15 05:02:33.064245 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.064210 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:33.139646 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139569 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-credential-socket\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139646 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139610 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-socket\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139646 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139643 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-certs\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139949 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139663 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-data\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139949 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139715 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vghsw\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-kube-api-access-vghsw\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139949 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139747 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-token\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139949 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139831 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-envoy\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139949 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139847 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:33.139949 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139859 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-podinfo\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.139949 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139914 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istiod-ca-cert\") pod \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\" (UID: \"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a\") " Jun 15 05:02:33.140316 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139950 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-data" (OuterVolumeSpecName: "istio-data") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:33.140316 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139966 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:33.140316 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.139983 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:33.140496 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.140337 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-certs\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.140496 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.140359 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-data\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.140496 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.140365 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:02:33.140496 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.140372 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-credential-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.140496 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.140407 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-workload-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.142486 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.142440 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-kube-api-access-vghsw" (OuterVolumeSpecName: "kube-api-access-vghsw") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "kube-api-access-vghsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:02:33.142600 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.142540 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-token" (OuterVolumeSpecName: "istio-token") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:02:33.142839 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.142818 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 05:02:33.142991 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.142975 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" (UID: "884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:33.143793 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.143770 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh"] Jun 15 05:02:33.144169 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.144152 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" containerName="istio-proxy" Jun 15 05:02:33.144242 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.144172 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" containerName="istio-proxy" Jun 15 05:02:33.144296 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.144285 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" containerName="istio-proxy" Jun 15 05:02:33.147705 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.147670 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.150204 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.150180 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-20a82c4a-openshift-default-dockercfg-vz2xq\"" Jun 15 05:02:33.157471 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.157449 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh"] Jun 15 05:02:33.241495 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-socket\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241713 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241531 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istiod-ca-cert\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241713 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-token\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241713 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k9jr\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-kube-api-access-5k9jr\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241864 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-credential-socket\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241864 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-data\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241864 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241808 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-certs\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241864 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-envoy\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.241864 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-podinfo\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.242018 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241934 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vghsw\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-kube-api-access-vghsw\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.242018 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241945 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-token\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.242018 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241960 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-envoy\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.242018 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241972 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istio-podinfo\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.242018 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.241980 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a-istiod-ca-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:33.343139 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-socket\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343313 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istiod-ca-cert\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343313 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-token\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343313 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k9jr\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-kube-api-access-5k9jr\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343313 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343246 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-credential-socket\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343313 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-data\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343598 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-certs\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343598 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343342 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-envoy\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343598 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343366 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-podinfo\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343766 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343601 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-socket\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343809 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343788 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-credential-socket\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.343938 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.343914 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-data\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.344209 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.344176 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-certs\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.344382 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.344363 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istiod-ca-cert\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.345801 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.345777 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-envoy\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.345960 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.345945 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-podinfo\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.351493 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.351471 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k9jr\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-kube-api-access-5k9jr\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.352323 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.352302 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-token\") pod \"e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.468855 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.468776 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:33.603337 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.603310 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh"] Jun 15 05:02:33.605138 ip-10-0-136-236 kubenswrapper[2554]: W0615 05:02:33.605114 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075d3fd7_e3c0_42d0_b661_47f1c75be30a.slice/crio-a73fad2d4fa9fc0fa65f6851c724fa4ad5958503f4d56c5e018c050c5999acfd WatchSource:0}: Error finding container a73fad2d4fa9fc0fa65f6851c724fa4ad5958503f4d56c5e018c050c5999acfd: Status 404 returned error can't find the container with id a73fad2d4fa9fc0fa65f6851c724fa4ad5958503f4d56c5e018c050c5999acfd Jun 15 05:02:33.608046 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.608014 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:33.608123 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.608077 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:33.608123 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.608106 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:33.839069 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.839029 2554 generic.go:356] "Generic (PLEG): container finished" podID="884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" containerID="7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f" exitCode=0 Jun 15 05:02:33.839252 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.839071 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" event={"ID":"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a","Type":"ContainerDied","Data":"7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f"} Jun 15 05:02:33.839252 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.839100 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" Jun 15 05:02:33.839252 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.839121 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6" event={"ID":"884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a","Type":"ContainerDied","Data":"ecad77ef51bb4513c44bd6dca2f68853a422b975c1582a75cf87d97920dd084c"} Jun 15 05:02:33.839252 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.839152 2554 scope.go:117] "RemoveContainer" containerID="7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f" Jun 15 05:02:33.841338 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.841301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" event={"ID":"075d3fd7-e3c0-42d0-b661-47f1c75be30a","Type":"ContainerStarted","Data":"d101091a9708af06ee7476f59e443b13d83c8bcc499415f8f291f691971893bb"} Jun 15 05:02:33.841448 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.841355 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" event={"ID":"075d3fd7-e3c0-42d0-b661-47f1c75be30a","Type":"ContainerStarted","Data":"a73fad2d4fa9fc0fa65f6851c724fa4ad5958503f4d56c5e018c050c5999acfd"} Jun 15 05:02:33.851079 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.851064 2554 scope.go:117] "RemoveContainer" containerID="7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f" Jun 15 05:02:33.851366 ip-10-0-136-236 kubenswrapper[2554]: E0615 05:02:33.851347 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f\": container with ID starting with 7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f not found: ID does not exist" containerID="7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f" Jun 15 05:02:33.851423 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.851374 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f"} err="failed to get container status \"7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f\": rpc error: code = NotFound desc = could not find container \"7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f\": container with ID starting with 7b61d1731a9cbe25fdbf618265e421885a02effbdcb270f1df688eb2f4ef458f not found: ID does not exist" Jun 15 05:02:33.863551 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.863426 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" podStartSLOduration=0.863409152 podStartE2EDuration="863.409152ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:02:33.863060068 +0000 UTC m=+2226.426355011" watchObservedRunningTime="2026-06-15 05:02:33.863409152 +0000 UTC m=+2226.426704078" Jun 15 05:02:33.878507 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.878472 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6"] Jun 15 05:02:33.884766 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:33.884739 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9984d613-openshift-default-594f89bdf4-qwdg6"] Jun 15 05:02:34.469751 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:34.469716 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:34.474656 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:34.474630 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:34.846888 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:34.846860 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:34.847893 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:34.847863 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:35.829479 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:35.829444 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a" path="/var/lib/kubelet/pods/884a2fc5-d2f8-43ae-bb3b-afcf67c4c50a/volumes" Jun 15 05:02:40.676305 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:40.676219 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh"] Jun 15 05:02:40.676779 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:40.676451 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" podUID="075d3fd7-e3c0-42d0-b661-47f1c75be30a" containerName="istio-proxy" containerID="cri-o://d101091a9708af06ee7476f59e443b13d83c8bcc499415f8f291f691971893bb" gracePeriod=30 Jun 15 05:02:45.899026 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:45.898988 2554 generic.go:356] "Generic (PLEG): container finished" podID="075d3fd7-e3c0-42d0-b661-47f1c75be30a" containerID="d101091a9708af06ee7476f59e443b13d83c8bcc499415f8f291f691971893bb" exitCode=0 Jun 15 05:02:45.899503 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:45.899062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" event={"ID":"075d3fd7-e3c0-42d0-b661-47f1c75be30a","Type":"ContainerDied","Data":"d101091a9708af06ee7476f59e443b13d83c8bcc499415f8f291f691971893bb"} Jun 15 05:02:45.936563 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:45.936506 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:46.067481 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067446 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istiod-ca-cert\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067495 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-socket\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067521 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-data\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067614 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k9jr\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-kube-api-access-5k9jr\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067870 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067704 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-envoy\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067870 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067744 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-credential-socket\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067870 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067769 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-podinfo\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067870 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067800 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-certs\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.067870 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067800 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:46.067870 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067834 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-token\") pod \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\" (UID: \"075d3fd7-e3c0-42d0-b661-47f1c75be30a\") " Jun 15 05:02:46.068117 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067941 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-data" (OuterVolumeSpecName: "istio-data") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:46.068117 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.067949 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:02:46.068186 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.068115 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istiod-ca-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.068186 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.068129 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.068186 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.068138 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-data\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.069684 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.069647 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:46.069947 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.069919 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:46.070027 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.069934 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:46.071436 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.071410 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-kube-api-access-5k9jr" (OuterVolumeSpecName: "kube-api-access-5k9jr") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "kube-api-access-5k9jr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:02:46.071590 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.071568 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 05:02:46.071639 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.071621 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-token" (OuterVolumeSpecName: "istio-token") pod "075d3fd7-e3c0-42d0-b661-47f1c75be30a" (UID: "075d3fd7-e3c0-42d0-b661-47f1c75be30a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:02:46.169519 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.169478 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k9jr\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-kube-api-access-5k9jr\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.169519 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.169520 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-envoy\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.169743 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.169535 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-credential-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.169743 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.169546 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-podinfo\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.169743 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.169560 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/075d3fd7-e3c0-42d0-b661-47f1c75be30a-workload-certs\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.169743 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.169572 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/075d3fd7-e3c0-42d0-b661-47f1c75be30a-istio-token\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:46.875386 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.875351 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2"] Jun 15 05:02:46.875771 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.875756 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="075d3fd7-e3c0-42d0-b661-47f1c75be30a" containerName="istio-proxy" Jun 15 05:02:46.875824 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.875774 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="075d3fd7-e3c0-42d0-b661-47f1c75be30a" containerName="istio-proxy" Jun 15 05:02:46.875859 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.875850 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="075d3fd7-e3c0-42d0-b661-47f1c75be30a" containerName="istio-proxy" Jun 15 05:02:46.879222 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.879199 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.881907 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.881877 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-invalid-859290e5-openshift-default-dockercfg-vvt84\"" Jun 15 05:02:46.892829 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.892802 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2"] Jun 15 05:02:46.905553 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.905524 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" event={"ID":"075d3fd7-e3c0-42d0-b661-47f1c75be30a","Type":"ContainerDied","Data":"a73fad2d4fa9fc0fa65f6851c724fa4ad5958503f4d56c5e018c050c5999acfd"} Jun 15 05:02:46.905938 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.905578 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh" Jun 15 05:02:46.905938 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.905591 2554 scope.go:117] "RemoveContainer" containerID="d101091a9708af06ee7476f59e443b13d83c8bcc499415f8f291f691971893bb" Jun 15 05:02:46.928320 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.928282 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh"] Jun 15 05:02:46.932322 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.932297 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-20a82c4a-openshift-default-95d9b6464-wxhhh"] Jun 15 05:02:46.979494 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979456 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-podinfo\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979656 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-credential-socket\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979656 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979636 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76ln5\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-kube-api-access-76ln5\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979792 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istiod-ca-cert\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979792 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-socket\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979877 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-token\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979877 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-certs\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979965 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979906 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-envoy\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:46.979965 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:46.979923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-data\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081084 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-podinfo\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081300 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-credential-socket\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081300 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081124 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76ln5\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-kube-api-access-76ln5\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081300 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081230 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istiod-ca-cert\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081300 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-socket\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081535 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-token\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081535 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081349 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-certs\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081535 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081464 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-envoy\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081535 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-data\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081783 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081584 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-socket\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081783 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081725 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-certs\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081893 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081840 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-credential-socket\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081932 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081887 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-data\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.081973 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.081948 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istiod-ca-cert\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.083538 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.083515 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-envoy\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.083704 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.083669 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-podinfo\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.088960 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.088936 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-token\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.089067 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.089013 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76ln5\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-kube-api-access-76ln5\") pod \"e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.193443 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.193343 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:47.331009 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.330961 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2"] Jun 15 05:02:47.333488 ip-10-0-136-236 kubenswrapper[2554]: W0615 05:02:47.333459 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef2707f_8ffc_4fcd_be11_80430e5d4d84.slice/crio-f3adf6c98e5cd95432cbd93c4009a230a7c30761d4e4dfaee4aa0454b27c5cb8 WatchSource:0}: Error finding container f3adf6c98e5cd95432cbd93c4009a230a7c30761d4e4dfaee4aa0454b27c5cb8: Status 404 returned error can't find the container with id f3adf6c98e5cd95432cbd93c4009a230a7c30761d4e4dfaee4aa0454b27c5cb8 Jun 15 05:02:47.335975 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.335933 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:47.336069 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.336032 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:47.336114 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.336072 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:02:47.472774 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.472686 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2"] Jun 15 05:02:47.831447 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.831412 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="075d3fd7-e3c0-42d0-b661-47f1c75be30a" path="/var/lib/kubelet/pods/075d3fd7-e3c0-42d0-b661-47f1c75be30a/volumes" Jun 15 05:02:47.913752 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.913719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" event={"ID":"5ef2707f-8ffc-4fcd-be11-80430e5d4d84","Type":"ContainerStarted","Data":"bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3"} Jun 15 05:02:47.914110 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.913769 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" event={"ID":"5ef2707f-8ffc-4fcd-be11-80430e5d4d84","Type":"ContainerStarted","Data":"f3adf6c98e5cd95432cbd93c4009a230a7c30761d4e4dfaee4aa0454b27c5cb8"} Jun 15 05:02:47.914110 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.913939 2554 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" secret="" err="secret \"e2e-invalid-859290e5-openshift-default-dockercfg-vvt84\" not found" Jun 15 05:02:47.946144 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:47.946100 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" podStartSLOduration=1.946085306 podStartE2EDuration="1.946085306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:02:47.944716231 +0000 UTC m=+2240.508011156" watchObservedRunningTime="2026-06-15 05:02:47.946085306 +0000 UTC m=+2240.509380230" Jun 15 05:02:48.194037 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:48.193946 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:48.195495 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:48.195466 2554 patch_prober.go:28] interesting pod/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 15 05:02:48.195638 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:48.195520 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" podUID="5ef2707f-8ffc-4fcd-be11-80430e5d4d84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 15 05:02:48.918344 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:48.918295 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" podUID="5ef2707f-8ffc-4fcd-be11-80430e5d4d84" containerName="istio-proxy" containerID="cri-o://bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3" gracePeriod=30 Jun 15 05:02:54.167805 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.167776 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:54.251707 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251609 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-podinfo\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251707 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251652 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76ln5\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-kube-api-access-76ln5\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251707 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251698 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-socket\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251991 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251719 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-token\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251991 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251737 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-credential-socket\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251991 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251764 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-certs\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251991 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251780 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-envoy\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251991 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251801 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-data\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.251991 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.251848 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istiod-ca-cert\") pod \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\" (UID: \"5ef2707f-8ffc-4fcd-be11-80430e5d4d84\") " Jun 15 05:02:54.252309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.252061 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:54.252309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.252086 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:54.252309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.252225 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.252309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.252246 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-credential-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.252309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.252279 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:54.252309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.252298 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:54.252852 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.252376 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:02:54.253838 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.253813 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 05:02:54.253966 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.253850 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-kube-api-access-76ln5" (OuterVolumeSpecName: "kube-api-access-76ln5") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "kube-api-access-76ln5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:02:54.253966 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.253919 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:02:54.254051 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.253995 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ef2707f-8ffc-4fcd-be11-80430e5d4d84" (UID: "5ef2707f-8ffc-4fcd-be11-80430e5d4d84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:02:54.352660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.352626 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istiod-ca-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.352660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.352653 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-podinfo\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.352660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.352663 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76ln5\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-kube-api-access-76ln5\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.352660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.352692 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-token\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.352944 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.352701 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-workload-certs\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.352944 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.352710 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-envoy\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.352944 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.352718 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef2707f-8ffc-4fcd-be11-80430e5d4d84-istio-data\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:02:54.948105 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.948075 2554 generic.go:356] "Generic (PLEG): container finished" podID="5ef2707f-8ffc-4fcd-be11-80430e5d4d84" containerID="bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3" exitCode=0 Jun 15 05:02:54.948283 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.948121 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" Jun 15 05:02:54.948283 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.948156 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" event={"ID":"5ef2707f-8ffc-4fcd-be11-80430e5d4d84","Type":"ContainerDied","Data":"bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3"} Jun 15 05:02:54.948283 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.948212 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2" event={"ID":"5ef2707f-8ffc-4fcd-be11-80430e5d4d84","Type":"ContainerDied","Data":"f3adf6c98e5cd95432cbd93c4009a230a7c30761d4e4dfaee4aa0454b27c5cb8"} Jun 15 05:02:54.948283 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.948233 2554 scope.go:117] "RemoveContainer" containerID="bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3" Jun 15 05:02:54.957842 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.957824 2554 scope.go:117] "RemoveContainer" containerID="bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3" Jun 15 05:02:54.958081 ip-10-0-136-236 kubenswrapper[2554]: E0615 05:02:54.958061 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3\": container with ID starting with bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3 not found: ID does not exist" containerID="bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3" Jun 15 05:02:54.958146 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.958089 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3"} err="failed to get container status \"bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3\": rpc error: code = NotFound desc = could not find container \"bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3\": container with ID starting with bc06d45c859bc03d22ec24bd0328118ba2dd5b26cbb5e3472c995f2ac5093db3 not found: ID does not exist" Jun 15 05:02:54.969042 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.969018 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2"] Jun 15 05:02:54.972865 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:54.972841 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-invalid-859290e5-openshift-default-56c59bb44b-dlrw2"] Jun 15 05:02:55.829255 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:02:55.829221 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef2707f-8ffc-4fcd-be11-80430e5d4d84" path="/var/lib/kubelet/pods/5ef2707f-8ffc-4fcd-be11-80430e5d4d84/volumes" Jun 15 05:04:17.507803 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:17.507718 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:04:21.084993 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:21.084955 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:04:27.386742 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:27.386708 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:04:31.462209 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.462172 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq"] Jun 15 05:04:31.462757 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.462735 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef2707f-8ffc-4fcd-be11-80430e5d4d84" containerName="istio-proxy" Jun 15 05:04:31.462824 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.462761 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef2707f-8ffc-4fcd-be11-80430e5d4d84" containerName="istio-proxy" Jun 15 05:04:31.462910 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.462897 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef2707f-8ffc-4fcd-be11-80430e5d4d84" containerName="istio-proxy" Jun 15 05:04:31.466279 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.466257 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.468795 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.468769 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 05:04:31.468890 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.468844 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a48c6af5-openshift-default-dockercfg-7pgdt\"" Jun 15 05:04:31.482502 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.482477 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq"] Jun 15 05:04:31.562065 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562015 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-socket\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562065 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-data\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562320 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562097 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-credential-socket\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562320 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562119 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-podinfo\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562320 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562147 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istiod-ca-cert\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562320 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-token\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562320 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562293 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-envoy\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562320 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5b9j\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-kube-api-access-w5b9j\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.562522 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.562361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-certs\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.662843 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.662808 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-certs\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663046 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.662862 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-socket\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663046 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.662895 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-data\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663046 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.662932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-credential-socket\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663046 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.662960 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-podinfo\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663046 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.662993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istiod-ca-cert\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663307 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663060 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-token\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663307 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-envoy\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663307 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5b9j\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-kube-api-access-w5b9j\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663307 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663296 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-certs\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663499 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663388 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-socket\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663559 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663510 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-data\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663620 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663588 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-credential-socket\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.663832 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.663810 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istiod-ca-cert\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.665302 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.665277 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-envoy\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.665549 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.665530 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-podinfo\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.670995 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.670973 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-token\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.671319 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.671303 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5b9j\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-kube-api-access-w5b9j\") pod \"e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.777855 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.777818 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:31.909721 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.909688 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq"] Jun 15 05:04:31.913128 ip-10-0-136-236 kubenswrapper[2554]: W0615 05:04:31.912490 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7baa0d6_b69b_4ad9_afb1_8b61ad9b8154.slice/crio-c8b6c18b696176c84d3f95c2c098a51cac4e549c3a6e9aea03fa8cfabf21cabc WatchSource:0}: Error finding container c8b6c18b696176c84d3f95c2c098a51cac4e549c3a6e9aea03fa8cfabf21cabc: Status 404 returned error can't find the container with id c8b6c18b696176c84d3f95c2c098a51cac4e549c3a6e9aea03fa8cfabf21cabc Jun 15 05:04:31.915062 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.915015 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:04:31.915181 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.915094 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:04:31.915181 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:31.915140 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 05:04:32.408361 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:32.408326 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" event={"ID":"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154","Type":"ContainerStarted","Data":"a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec"} Jun 15 05:04:32.408561 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:32.408380 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" event={"ID":"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154","Type":"ContainerStarted","Data":"c8b6c18b696176c84d3f95c2c098a51cac4e549c3a6e9aea03fa8cfabf21cabc"} Jun 15 05:04:32.447724 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:32.447653 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" podStartSLOduration=1.447639799 podStartE2EDuration="1.447639799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:04:32.445648781 +0000 UTC m=+2345.008943756" watchObservedRunningTime="2026-06-15 05:04:32.447639799 +0000 UTC m=+2345.010934722" Jun 15 05:04:32.778500 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:32.778467 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:32.783382 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:32.783354 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:33.414023 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:33.413992 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:33.414887 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:33.414868 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:50.686086 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:50.686053 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq"] Jun 15 05:04:50.686640 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:50.686246 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" podUID="e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" containerName="istio-proxy" containerID="cri-o://a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec" gracePeriod=30 Jun 15 05:04:55.939107 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.939082 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:55.993919 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.993894 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-credential-socket\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994052 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.993934 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-podinfo\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994052 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.993962 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-socket\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994052 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.993984 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istiod-ca-cert\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994052 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994008 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5b9j\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-kube-api-access-w5b9j\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994052 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994031 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-certs\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994318 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994098 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-envoy\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994318 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994139 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-data\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994318 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994159 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-token\") pod \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\" (UID: \"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154\") " Jun 15 05:04:55.994318 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994239 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:04:55.994318 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994256 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:04:55.994596 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994466 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:04:55.994596 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994522 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:04:55.994723 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994613 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-credential-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:55.994723 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994631 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-socket\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:55.994723 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994644 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-workload-certs\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:55.994723 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994656 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-data\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:55.994723 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.994694 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 05:04:55.996457 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.996428 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 05:04:55.996701 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.996659 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-kube-api-access-w5b9j" (OuterVolumeSpecName: "kube-api-access-w5b9j") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "kube-api-access-w5b9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:04:55.996967 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.996947 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 05:04:55.996967 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:55.996953 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" (UID: "e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 05:04:56.096137 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.096100 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-podinfo\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:56.096137 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.096129 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istiod-ca-cert\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:56.096137 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.096139 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5b9j\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-kube-api-access-w5b9j\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:56.096137 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.096147 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-envoy\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:56.096407 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.096156 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154-istio-token\") on node \"ip-10-0-136-236.ec2.internal\" DevicePath \"\"" Jun 15 05:04:56.524319 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.524279 2554 generic.go:356] "Generic (PLEG): container finished" podID="e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" containerID="a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec" exitCode=0 Jun 15 05:04:56.524495 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.524333 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" Jun 15 05:04:56.524495 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.524360 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" event={"ID":"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154","Type":"ContainerDied","Data":"a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec"} Jun 15 05:04:56.524495 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.524418 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq" event={"ID":"e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154","Type":"ContainerDied","Data":"c8b6c18b696176c84d3f95c2c098a51cac4e549c3a6e9aea03fa8cfabf21cabc"} Jun 15 05:04:56.524495 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.524440 2554 scope.go:117] "RemoveContainer" containerID="a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec" Jun 15 05:04:56.534035 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.534022 2554 scope.go:117] "RemoveContainer" containerID="a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec" Jun 15 05:04:56.534299 ip-10-0-136-236 kubenswrapper[2554]: E0615 05:04:56.534276 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec\": container with ID starting with a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec not found: ID does not exist" containerID="a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec" Jun 15 05:04:56.534352 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.534310 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec"} err="failed to get container status \"a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec\": rpc error: code = NotFound desc = could not find container \"a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec\": container with ID starting with a112298e5569a77fbf5e6b7eecfe5e0d29f440c7bdfd5eb403ec4619699b1fec not found: ID does not exist" Jun 15 05:04:56.546379 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.546353 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq"] Jun 15 05:04:56.548016 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:56.547996 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a48c6af5-openshift-default-7c84d8574b-khtvq"] Jun 15 05:04:57.829313 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:04:57.829280 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" path="/var/lib/kubelet/pods/e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154/volumes" Jun 15 05:05:21.893834 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:21.893796 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:05:25.790940 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:25.790900 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:05:28.013492 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:28.013463 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 05:05:28.021140 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:28.021103 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 05:05:28.021930 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:28.021905 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 05:05:28.028686 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:28.028658 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 05:05:31.095436 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:31.095401 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:05:38.387886 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:05:38.387850 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshh7"] Jun 15 05:06:32.317153 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:32.317123 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691645-s2vrd_0f6ea354-ac53-4b24-9600-0626aa5fdb49/cleanup/0.log" Jun 15 05:06:32.446044 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:32.445995 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691660-sn7fw_605424c6-a50d-4896-ad3c-f3f75c22caf8/cleanup/0.log" Jun 15 05:06:32.578656 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:32.578566 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-95596b4f9-jzm74_abc516ee-293d-480e-b449-207e7ea51f17/manager/0.log" Jun 15 05:06:32.953816 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:32.953737 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-ddnc5_e5e77790-a013-4b92-86c1-3bcec37b5a31/manager/0.log" Jun 15 05:06:32.961634 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:32.961609 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-ddnc5_e5e77790-a013-4b92-86c1-3bcec37b5a31/copy-manifests/0.log" Jun 15 05:06:35.055462 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:35.055428 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gzsvs_307fe53b-ed86-40c2-bdd3-e452eae74b5c/kuadrant-console-plugin/0.log" Jun 15 05:06:35.459477 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:35.459396 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pshh7_fc023837-45ef-45dc-90a1-330e6f392600/limitador/0.log" Jun 15 05:06:36.285394 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:36.285351 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f88fdf6c8-grdb5_66582d92-62c5-44c2-b1b5-47229dbb3655/kube-auth-proxy/0.log" Jun 15 05:06:36.780368 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:36.780339 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f46d5878-vxjd7_d41d8e9b-3491-4d50-8451-424688a6347e/router/0.log" Jun 15 05:06:37.172057 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:37.171977 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-6799l_45cebbf6-e633-4132-b241-9cad04759814/storage-initializer/0.log" Jun 15 05:06:37.181845 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:37.181809 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-6799l_45cebbf6-e633-4132-b241-9cad04759814/main/0.log" Jun 15 05:06:37.789612 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:37.789577 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-jdhng_e851d7fb-0a9d-405d-b8e7-d59015771e28/storage-initializer/0.log" Jun 15 05:06:37.798309 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:37.798278 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-jdhng_e851d7fb-0a9d-405d-b8e7-d59015771e28/main/0.log" Jun 15 05:06:41.806712 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.806666 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l6v9r/must-gather-j5lfr"] Jun 15 05:06:41.807080 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.807008 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" containerName="istio-proxy" Jun 15 05:06:41.807080 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.807019 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" containerName="istio-proxy" Jun 15 05:06:41.807161 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.807108 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7baa0d6-b69b-4ad9-afb1-8b61ad9b8154" containerName="istio-proxy" Jun 15 05:06:41.810469 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.810454 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:41.812952 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.812924 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l6v9r\"/\"kube-root-ca.crt\"" Jun 15 05:06:41.813090 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.812981 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l6v9r\"/\"openshift-service-ca.crt\"" Jun 15 05:06:41.813090 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.812986 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l6v9r\"/\"default-dockercfg-zvzng\"" Jun 15 05:06:41.830247 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.830222 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l6v9r/must-gather-j5lfr"] Jun 15 05:06:41.870103 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.870074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f1d1ec42-d160-43e9-b859-036ef29b58e7-must-gather-output\") pod \"must-gather-j5lfr\" (UID: \"f1d1ec42-d160-43e9-b859-036ef29b58e7\") " pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:41.870253 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.870122 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdtp6\" (UniqueName: \"kubernetes.io/projected/f1d1ec42-d160-43e9-b859-036ef29b58e7-kube-api-access-xdtp6\") pod \"must-gather-j5lfr\" (UID: \"f1d1ec42-d160-43e9-b859-036ef29b58e7\") " pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:41.971250 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.971210 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f1d1ec42-d160-43e9-b859-036ef29b58e7-must-gather-output\") pod \"must-gather-j5lfr\" (UID: \"f1d1ec42-d160-43e9-b859-036ef29b58e7\") " pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:41.971433 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.971270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdtp6\" (UniqueName: \"kubernetes.io/projected/f1d1ec42-d160-43e9-b859-036ef29b58e7-kube-api-access-xdtp6\") pod \"must-gather-j5lfr\" (UID: \"f1d1ec42-d160-43e9-b859-036ef29b58e7\") " pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:41.971558 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.971528 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f1d1ec42-d160-43e9-b859-036ef29b58e7-must-gather-output\") pod \"must-gather-j5lfr\" (UID: \"f1d1ec42-d160-43e9-b859-036ef29b58e7\") " pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:41.979519 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:41.979489 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdtp6\" (UniqueName: \"kubernetes.io/projected/f1d1ec42-d160-43e9-b859-036ef29b58e7-kube-api-access-xdtp6\") pod \"must-gather-j5lfr\" (UID: \"f1d1ec42-d160-43e9-b859-036ef29b58e7\") " pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:42.120107 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:42.120028 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l6v9r/must-gather-j5lfr" Jun 15 05:06:42.246488 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:42.246459 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l6v9r/must-gather-j5lfr"] Jun 15 05:06:42.247939 ip-10-0-136-236 kubenswrapper[2554]: W0615 05:06:42.247913 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1d1ec42_d160_43e9_b859_036ef29b58e7.slice/crio-32597156a2632d5aa492a54b11c3efa8030068d327df2203114b1f516e91c14d WatchSource:0}: Error finding container 32597156a2632d5aa492a54b11c3efa8030068d327df2203114b1f516e91c14d: Status 404 returned error can't find the container with id 32597156a2632d5aa492a54b11c3efa8030068d327df2203114b1f516e91c14d Jun 15 05:06:43.016615 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:43.016586 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l6v9r/must-gather-j5lfr" event={"ID":"f1d1ec42-d160-43e9-b859-036ef29b58e7","Type":"ContainerStarted","Data":"e3010aed87d73a07bb6dd64188440742b96461baad0ebeabcc5dc8d94e5dfcd5"} Jun 15 05:06:43.016934 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:43.016631 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l6v9r/must-gather-j5lfr" event={"ID":"f1d1ec42-d160-43e9-b859-036ef29b58e7","Type":"ContainerStarted","Data":"32597156a2632d5aa492a54b11c3efa8030068d327df2203114b1f516e91c14d"} Jun 15 05:06:44.024697 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:44.024645 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l6v9r/must-gather-j5lfr" event={"ID":"f1d1ec42-d160-43e9-b859-036ef29b58e7","Type":"ContainerStarted","Data":"8026e91ebab85a624808dba68ab77c7687e6ce4e84fab48bff2a5513ea40525e"} Jun 15 05:06:44.040838 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:44.040784 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l6v9r/must-gather-j5lfr" podStartSLOduration=2.368383637 podStartE2EDuration="3.040768574s" totalImagesPullingTime="672.384937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 05:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:06:44.038517096 +0000 UTC m=+2476.601812021" watchObservedRunningTime="2026-06-15 05:06:44.040768574 +0000 UTC m=+2476.604063497" Jun 15 05:06:44.637067 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:44.637033 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lwphn_86e420ba-4a99-443e-92e3-86d4d76be538/global-pull-secret-syncer/0.log" Jun 15 05:06:44.772685 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:44.772633 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wdmg5_aaa4f0d7-fd67-4607-bd66-83f8a56e7ead/konnectivity-agent/0.log" Jun 15 05:06:44.801549 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:44.801507 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-236.ec2.internal_9bab8913c76df9e2a70aeb901b774a32/haproxy/0.log" Jun 15 05:06:50.015100 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:50.015049 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gzsvs_307fe53b-ed86-40c2-bdd3-e452eae74b5c/kuadrant-console-plugin/0.log" Jun 15 05:06:50.162105 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:50.162050 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pshh7_fc023837-45ef-45dc-90a1-330e6f392600/limitador/0.log" Jun 15 05:06:51.901364 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:51.901203 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d4b2bde-d8fc-4d58-84e5-c864f05f33ef/alertmanager/0.log" Jun 15 05:06:51.926852 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:51.926607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d4b2bde-d8fc-4d58-84e5-c864f05f33ef/config-reloader/0.log" Jun 15 05:06:51.947666 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:51.947640 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d4b2bde-d8fc-4d58-84e5-c864f05f33ef/kube-rbac-proxy-web/0.log" Jun 15 05:06:51.968826 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:51.968694 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d4b2bde-d8fc-4d58-84e5-c864f05f33ef/kube-rbac-proxy/0.log" Jun 15 05:06:51.987859 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:51.987833 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d4b2bde-d8fc-4d58-84e5-c864f05f33ef/kube-rbac-proxy-metric/0.log" Jun 15 05:06:52.007748 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.007716 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d4b2bde-d8fc-4d58-84e5-c864f05f33ef/prom-label-proxy/0.log" Jun 15 05:06:52.026892 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.026818 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d4b2bde-d8fc-4d58-84e5-c864f05f33ef/init-config-reloader/0.log" Jun 15 05:06:52.080196 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.080159 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-wcxv4_92eb6924-4d9f-4306-a45d-4a89cd012bff/cluster-monitoring-operator/0.log" Jun 15 05:06:52.284583 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.284554 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksgfw_75a973d2-a8f9-42b2-a6dd-35c7a4965842/node-exporter/0.log" Jun 15 05:06:52.302291 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.302263 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksgfw_75a973d2-a8f9-42b2-a6dd-35c7a4965842/kube-rbac-proxy/0.log" Jun 15 05:06:52.322493 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.322471 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksgfw_75a973d2-a8f9-42b2-a6dd-35c7a4965842/init-textfile/0.log" Jun 15 05:06:52.533373 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.533346 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15c0e28a-175e-4d3a-af0e-f9324a823e70/prometheus/0.log" Jun 15 05:06:52.560643 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.560562 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15c0e28a-175e-4d3a-af0e-f9324a823e70/config-reloader/0.log" Jun 15 05:06:52.582636 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.582606 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15c0e28a-175e-4d3a-af0e-f9324a823e70/thanos-sidecar/0.log" Jun 15 05:06:52.606181 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.606151 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15c0e28a-175e-4d3a-af0e-f9324a823e70/kube-rbac-proxy-web/0.log" Jun 15 05:06:52.634509 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.634478 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15c0e28a-175e-4d3a-af0e-f9324a823e70/kube-rbac-proxy/0.log" Jun 15 05:06:52.663005 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.662904 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15c0e28a-175e-4d3a-af0e-f9324a823e70/kube-rbac-proxy-thanos/0.log" Jun 15 05:06:52.692485 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.692451 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15c0e28a-175e-4d3a-af0e-f9324a823e70/init-config-reloader/0.log" Jun 15 05:06:52.722803 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.722771 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-sj22l_c2e96491-79ed-4319-a199-04c619eabef5/prometheus-operator/0.log" Jun 15 05:06:52.739346 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:52.739307 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-sj22l_c2e96491-79ed-4319-a199-04c619eabef5/kube-rbac-proxy/0.log" Jun 15 05:06:55.049280 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:55.049236 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/2.log" Jun 15 05:06:55.059449 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:55.059362 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-6xbp2_fde07d4b-ea1f-4221-b9d8-92775b213ac1/console-operator/3.log" Jun 15 05:06:56.296094 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.296067 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-nps7s_950cdc0f-8e01-4894-86b6-152cd8573bd3/volume-data-source-validator/0.log" Jun 15 05:06:56.836546 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.836513 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7"] Jun 15 05:06:56.842663 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.842638 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:56.848884 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.848858 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7"] Jun 15 05:06:56.921696 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.920816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-podres\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:56.921696 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.920889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-lib-modules\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:56.921696 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.920928 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5585g\" (UniqueName: \"kubernetes.io/projected/e7bf62dd-4a14-4655-860b-b18922a5dd02-kube-api-access-5585g\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:56.921696 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.921045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-proc\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:56.921696 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:56.921102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-sys\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022422 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-sys\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022624 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-podres\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022624 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022485 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-lib-modules\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022624 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5585g\" (UniqueName: \"kubernetes.io/projected/e7bf62dd-4a14-4655-860b-b18922a5dd02-kube-api-access-5585g\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022624 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022520 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-sys\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022624 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022594 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-podres\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022950 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-proc\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022950 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022644 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-lib-modules\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.022950 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.022714 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7bf62dd-4a14-4655-860b-b18922a5dd02-proc\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.031117 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.031092 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5585g\" (UniqueName: \"kubernetes.io/projected/e7bf62dd-4a14-4655-860b-b18922a5dd02-kube-api-access-5585g\") pod \"perf-node-gather-daemonset-48kk7\" (UID: \"e7bf62dd-4a14-4655-860b-b18922a5dd02\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.159419 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.159322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:57.335819 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.335785 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7"] Jun 15 05:06:57.339129 ip-10-0-136-236 kubenswrapper[2554]: W0615 05:06:57.339099 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7bf62dd_4a14_4655_860b_b18922a5dd02.slice/crio-bbd09ad5a718012a513e0cd16734a0204b11ee872dd87b910f3281075d8abe6c WatchSource:0}: Error finding container bbd09ad5a718012a513e0cd16734a0204b11ee872dd87b910f3281075d8abe6c: Status 404 returned error can't find the container with id bbd09ad5a718012a513e0cd16734a0204b11ee872dd87b910f3281075d8abe6c Jun 15 05:06:57.496584 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.496557 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhkm2_7cd4563d-c0e0-463e-b183-b74a32d1ef66/dns/0.log" Jun 15 05:06:57.515294 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.515261 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhkm2_7cd4563d-c0e0-463e-b183-b74a32d1ef66/kube-rbac-proxy/0.log" Jun 15 05:06:57.594822 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:57.594790 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g78tp_7b8646a2-3ef1-4b10-b0a4-2d3285297793/dns-node-resolver/0.log" Jun 15 05:06:58.113602 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:58.113568 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-667c798b7d-jjw75_e51c63b2-cb96-4905-92ce-90f45b848cdd/registry/0.log" Jun 15 05:06:58.129553 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:58.129514 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-667c798b7d-jjw75_e51c63b2-cb96-4905-92ce-90f45b848cdd/registry/1.log" Jun 15 05:06:58.132177 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:58.132139 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" event={"ID":"e7bf62dd-4a14-4655-860b-b18922a5dd02","Type":"ContainerStarted","Data":"b54c3e5912561a77e288f3083f6a0ac6b160985fe6b4918e205051cc6edc2df5"} Jun 15 05:06:58.132339 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:58.132210 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" event={"ID":"e7bf62dd-4a14-4655-860b-b18922a5dd02","Type":"ContainerStarted","Data":"bbd09ad5a718012a513e0cd16734a0204b11ee872dd87b910f3281075d8abe6c"} Jun 15 05:06:58.133058 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:58.133032 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:06:58.149913 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:58.149872 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" podStartSLOduration=2.149855841 podStartE2EDuration="2.149855841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:06:58.146974799 +0000 UTC m=+2490.710269738" watchObservedRunningTime="2026-06-15 05:06:58.149855841 +0000 UTC m=+2490.713150764" Jun 15 05:06:58.173332 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:58.173306 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gm67b_4a16488f-7114-48dd-9354-5b4e5b1cf71e/node-ca/0.log" Jun 15 05:06:59.156535 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:59.156504 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f88fdf6c8-grdb5_66582d92-62c5-44c2-b1b5-47229dbb3655/kube-auth-proxy/0.log" Jun 15 05:06:59.409861 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:06:59.409771 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f46d5878-vxjd7_d41d8e9b-3491-4d50-8451-424688a6347e/router/0.log" Jun 15 05:07:00.004640 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:00.004609 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clxdp_79938686-4627-46c4-83fd-13a544b741c2/serve-healthcheck-canary/0.log" Jun 15 05:07:00.524145 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:00.524110 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-zxq74_a9b0df88-f0d9-4a95-8159-728a6e4f8633/insights-operator/1.log" Jun 15 05:07:00.527183 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:00.527143 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-zxq74_a9b0df88-f0d9-4a95-8159-728a6e4f8633/insights-operator/0.log" Jun 15 05:07:00.650698 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:00.650653 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jp246_bf9d5088-0306-46f2-a1db-023aea808360/kube-rbac-proxy/0.log" Jun 15 05:07:00.669217 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:00.669183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jp246_bf9d5088-0306-46f2-a1db-023aea808360/exporter/0.log" Jun 15 05:07:00.689969 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:00.689939 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jp246_bf9d5088-0306-46f2-a1db-023aea808360/extractor/0.log" Jun 15 05:07:02.937511 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:02.937484 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691645-s2vrd_0f6ea354-ac53-4b24-9600-0626aa5fdb49/cleanup/0.log" Jun 15 05:07:02.958918 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:02.958892 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691660-sn7fw_605424c6-a50d-4896-ad3c-f3f75c22caf8/cleanup/0.log" Jun 15 05:07:03.080481 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:03.080447 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-95596b4f9-jzm74_abc516ee-293d-480e-b449-207e7ea51f17/manager/0.log" Jun 15 05:07:03.309315 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:03.309279 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-ddnc5_e5e77790-a013-4b92-86c1-3bcec37b5a31/manager/0.log" Jun 15 05:07:03.324399 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:03.324371 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-ddnc5_e5e77790-a013-4b92-86c1-3bcec37b5a31/copy-manifests/0.log" Jun 15 05:07:04.879989 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:04.879960 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56698c95d7-vpt58_1f24c144-eed8-4be5-97d5-bccd1452486f/manager/0.log" Jun 15 05:07:05.153702 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:05.153604 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-48kk7" Jun 15 05:07:09.859141 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:09.859062 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f88fdf6c8-grdb5_66582d92-62c5-44c2-b1b5-47229dbb3655/kube-auth-proxy/0.log" Jun 15 05:07:10.071403 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:10.071366 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f46d5878-vxjd7_d41d8e9b-3491-4d50-8451-424688a6347e/router/0.log" Jun 15 05:07:11.210905 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.210866 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f88fdf6c8-grdb5_66582d92-62c5-44c2-b1b5-47229dbb3655/kube-auth-proxy/0.log" Jun 15 05:07:11.433154 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.433111 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f46d5878-vxjd7_d41d8e9b-3491-4d50-8451-424688a6347e/router/0.log" Jun 15 05:07:11.663746 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.663703 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9nndf_6a165f07-7919-4ca4-aa9d-a1e5860a013b/kube-multus/0.log" Jun 15 05:07:11.808600 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.808576 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sz2kd_c1676af7-bcc1-4427-b25a-fca61b088bca/kube-multus-additional-cni-plugins/0.log" Jun 15 05:07:11.826771 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.826734 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sz2kd_c1676af7-bcc1-4427-b25a-fca61b088bca/egress-router-binary-copy/0.log" Jun 15 05:07:11.846348 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.846318 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sz2kd_c1676af7-bcc1-4427-b25a-fca61b088bca/cni-plugins/0.log" Jun 15 05:07:11.864301 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.864270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sz2kd_c1676af7-bcc1-4427-b25a-fca61b088bca/bond-cni-plugin/0.log" Jun 15 05:07:11.882693 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.882648 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sz2kd_c1676af7-bcc1-4427-b25a-fca61b088bca/routeoverride-cni/0.log" Jun 15 05:07:11.902515 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.902490 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sz2kd_c1676af7-bcc1-4427-b25a-fca61b088bca/whereabouts-cni-bincopy/0.log" Jun 15 05:07:11.920478 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:11.920404 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sz2kd_c1676af7-bcc1-4427-b25a-fca61b088bca/whereabouts-cni/0.log" Jun 15 05:07:12.212352 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:12.212277 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tqgb2_8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f/network-metrics-daemon/0.log" Jun 15 05:07:12.229061 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:12.229033 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tqgb2_8a4b4ccc-1f47-4e5e-bb63-7f57921d5c1f/kube-rbac-proxy/0.log" Jun 15 05:07:13.107004 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.106977 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f88fdf6c8-grdb5_66582d92-62c5-44c2-b1b5-47229dbb3655/kube-auth-proxy/0.log" Jun 15 05:07:13.356960 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.356929 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74f46d5878-vxjd7_d41d8e9b-3491-4d50-8451-424688a6347e/router/0.log" Jun 15 05:07:13.534174 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.534135 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-controller/0.log" Jun 15 05:07:13.550660 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.550625 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/1.log" Jun 15 05:07:13.551082 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.551065 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovn-acl-logging/0.log" Jun 15 05:07:13.580435 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.580405 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/kube-rbac-proxy-node/0.log" Jun 15 05:07:13.603191 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.603158 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/kube-rbac-proxy-ovn-metrics/0.log" Jun 15 05:07:13.621613 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.621585 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/northd/0.log" Jun 15 05:07:13.641979 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.641953 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/nbdb/0.log" Jun 15 05:07:13.661807 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.661778 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/sbdb/0.log" Jun 15 05:07:13.729909 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:13.729877 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g9xbf_b8665ac9-1463-4b0f-a1b7-fe6ce746a3f9/ovnkube-controller/0.log" Jun 15 05:07:14.932200 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:14.932172 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6947749cfc-n2j57_e6bcd3fc-8cf2-4232-91e2-f92a1a1bdce2/check-endpoints/0.log" Jun 15 05:07:14.957076 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:14.957049 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4tght_fca12851-aa26-45b5-ae7f-ddb4318e5fcb/network-check-target-container/0.log" Jun 15 05:07:15.487446 ip-10-0-136-236 kubenswrapper[2554]: I0615 05:07:15.487363 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f88fdf6c8-grdb5_66582d92-62c5-44c2-b1b5-47229dbb3655/kube-auth-proxy/0.log"