Jun 11 12:50:18.494701 ip-10-0-135-157 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 12:50:18.494808 ip-10-0-135-157 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 12:50:18.494824 ip-10-0-135-157 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 12:50:18.495033 ip-10-0-135-157 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 12:50:28.654165 ip-10-0-135-157 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 12:50:28.654182 ip-10-0-135-157 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a8478d31fe2444a9b127f45c9c6e9505 -- Jun 11 12:53:01.552001 ip-10-0-135-157 systemd[1]: Starting Kubernetes Kubelet... Jun 11 12:53:02.010007 ip-10-0-135-157 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:53:02.010007 ip-10-0-135-157 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 12:53:02.010007 ip-10-0-135-157 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:53:02.010007 ip-10-0-135-157 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 12:53:02.010007 ip-10-0-135-157 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:53:02.012184 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.012095 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 12:53:02.017111 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017084 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:02.017111 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017104 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:02.017111 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017107 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:02.017111 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017111 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:02.017111 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017114 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:02.017111 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017116 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:02.017111 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017119 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017124 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017128 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017131 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017135 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017138 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017140 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017144 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017147 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017150 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017152 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017155 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017157 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017160 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017162 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017166 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017170 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017173 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017176 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:02.017368 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017179 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017182 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017185 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017187 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017190 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017192 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017195 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017197 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017200 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017203 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017206 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017208 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017211 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017214 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017217 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017220 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017223 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017226 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017228 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:02.017858 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017231 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017234 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017236 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017239 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017241 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017244 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017247 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017249 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017252 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017255 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017257 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017260 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017263 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017266 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017268 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017271 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017274 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017278 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017281 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:02.018633 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017284 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017287 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017290 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017293 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017295 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017298 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017300 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017303 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017306 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017310 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017313 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017316 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017318 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017321 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017324 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017327 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017329 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017332 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017334 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017337 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:02.019159 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017341 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017343 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017346 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017348 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017351 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017353 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017356 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017359 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017361 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017364 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017366 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017369 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017372 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017376 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017379 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.017382 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018119 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018127 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018130 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018133 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:02.019709 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018135 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018143 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018146 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018149 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018152 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018155 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018158 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018160 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018163 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018167 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018171 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018174 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018177 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018180 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018183 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018186 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018189 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018191 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018194 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:02.020234 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018196 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018199 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018201 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018204 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018207 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018210 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018213 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018216 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018219 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018221 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018224 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018226 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018229 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018232 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018234 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018237 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018240 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018244 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018247 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:02.020722 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018250 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018253 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018256 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018259 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018262 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018265 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018268 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018271 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018274 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018277 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018280 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018282 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018285 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018288 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018290 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018293 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018295 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018298 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018301 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018305 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:02.021190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018307 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018310 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018313 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018315 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018318 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018320 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018323 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018325 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018328 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018331 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018334 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018336 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018339 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018342 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018344 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018346 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018349 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018352 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018384 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018388 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:02.021698 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018391 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018393 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018397 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018400 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018403 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018407 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018410 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018413 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018416 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018418 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018421 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018425 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018428 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018431 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018434 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018437 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.018440 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019565 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019572 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:02.022220 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019577 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019581 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019585 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019588 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019591 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019594 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019596 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019599 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019602 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019604 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019607 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019609 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019612 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019614 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019617 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019621 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019625 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019628 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019631 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:02.022705 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019634 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019637 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019639 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019642 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019645 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019648 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019650 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019653 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019656 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019670 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019674 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019678 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019682 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019686 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019691 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019696 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019700 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019703 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019706 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019708 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:02.023175 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019711 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019714 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019717 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019720 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019723 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019727 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019730 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019733 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019735 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019738 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019741 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019743 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019746 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019748 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019751 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019753 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019756 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019759 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019762 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:02.023658 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019765 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019767 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019770 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019773 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019776 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019779 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019781 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019784 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019793 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019796 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019804 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019807 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019810 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019812 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019815 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019817 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019820 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019822 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019825 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019827 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:02.024186 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019830 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019832 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019835 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019838 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019840 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019842 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019845 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019847 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019850 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019853 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019856 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019859 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019861 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019864 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019866 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019869 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019871 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019874 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.019877 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019949 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019956 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 12:53:02.024714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019966 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019971 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019984 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019989 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019993 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.019998 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020001 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020004 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020008 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020011 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020014 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020017 2577 flags.go:64] FLAG: --cgroup-root="" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020021 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020024 2577 flags.go:64] FLAG: --client-ca-file="" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020027 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020030 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020037 2577 flags.go:64] FLAG: --cluster-domain="" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020040 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020043 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020046 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020054 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020061 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020064 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 12:53:02.025233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020067 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020070 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020073 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020077 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020080 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020083 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020086 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020090 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020093 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020096 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020099 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020102 2577 flags.go:64] FLAG: --enable-server="true" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020111 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020118 2577 flags.go:64] FLAG: --event-burst="100" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020121 2577 flags.go:64] FLAG: --event-qps="50" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020124 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020127 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020130 2577 flags.go:64] FLAG: --eviction-hard="" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020134 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020137 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020140 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020145 2577 flags.go:64] FLAG: --eviction-soft="" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020148 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020150 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020153 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 12:53:02.025815 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020156 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020159 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020163 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020165 2577 flags.go:64] FLAG: --feature-gates="" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020171 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020174 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020177 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020180 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020183 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020186 2577 flags.go:64] FLAG: --help="false" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020189 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020192 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020195 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020198 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020201 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020205 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020208 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020211 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020214 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020216 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020226 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020230 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020233 2577 flags.go:64] FLAG: --kube-reserved="" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020236 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 12:53:02.026460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020238 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020242 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020245 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020248 2577 flags.go:64] FLAG: --lock-file="" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020252 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020255 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020258 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020264 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020267 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020270 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020273 2577 flags.go:64] FLAG: --logging-format="text" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020275 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020280 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020283 2577 flags.go:64] FLAG: --manifest-url="" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020286 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020291 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020294 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020298 2577 flags.go:64] FLAG: --max-pods="110" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020301 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020304 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020306 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020310 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020312 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020315 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020318 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 12:53:02.027097 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020326 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020329 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020332 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020334 2577 flags.go:64] FLAG: --pod-cidr="" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020343 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020349 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020352 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020355 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020358 2577 flags.go:64] FLAG: --port="10250" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020361 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020364 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cf4503df4ce97ec0" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020369 2577 flags.go:64] FLAG: --qos-reserved="" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020372 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020374 2577 flags.go:64] FLAG: --register-node="true" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020377 2577 flags.go:64] FLAG: --register-with-taints="" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020381 2577 flags.go:64] FLAG: --registry-burst="10" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020384 2577 flags.go:64] FLAG: --registry-qps="5" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020387 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020390 2577 flags.go:64] FLAG: --reserved-memory="" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020394 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020398 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020401 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020404 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020407 2577 flags.go:64] FLAG: --runonce="false" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020410 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 12:53:02.027758 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020413 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020416 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020419 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020422 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020425 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020428 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020431 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020434 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020437 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020439 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020442 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020445 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020454 2577 flags.go:64] FLAG: --system-cgroups="" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020457 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020462 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020465 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020468 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020474 2577 flags.go:64] FLAG: --tls-min-version="" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020478 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020481 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020484 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020487 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020490 2577 flags.go:64] FLAG: --v="2" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020494 2577 flags.go:64] FLAG: --version="false" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020497 2577 flags.go:64] FLAG: --vmodule="" Jun 11 12:53:02.028407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020501 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.020504 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020635 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020638 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020642 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020645 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020648 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020651 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020654 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020657 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020675 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020678 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020681 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020684 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020686 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020689 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020692 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020694 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020697 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:02.029089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020699 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020708 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020711 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020713 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020716 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020719 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020723 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020725 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020728 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020731 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020734 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020737 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020739 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020742 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020745 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020748 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020752 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020755 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020757 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020760 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:02.029590 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020763 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020781 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020785 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020788 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020791 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020794 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020797 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020801 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020805 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020808 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020811 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020813 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020816 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020818 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020826 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020829 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020831 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020834 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020837 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:02.030114 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020839 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020842 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020844 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020847 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020849 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020852 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020855 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020857 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020860 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020862 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020865 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020868 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020870 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020873 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020875 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020878 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020882 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020885 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020887 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020890 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:02.030587 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020892 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020895 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020897 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020900 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020902 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020905 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020907 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020910 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020913 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020915 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020918 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020920 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020923 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020926 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020928 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020930 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020933 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020936 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020938 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:02.031190 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020941 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020945 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020948 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.020951 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.021718 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.029248 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.029269 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.029290 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.029299 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029362 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029368 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029371 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029374 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029378 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:02.031775 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029381 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029383 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029388 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029392 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029395 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029398 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029401 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029403 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029406 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029409 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029411 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029414 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029417 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029420 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029422 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029425 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029429 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029432 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029435 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:02.032137 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029438 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029441 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029444 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029447 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029449 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029459 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029462 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029464 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029467 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029470 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029473 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029475 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029478 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029481 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029483 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029486 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029489 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029491 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029494 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029496 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:02.032603 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029499 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029502 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029504 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029507 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029509 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029512 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029515 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029517 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029520 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029522 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029525 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029527 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029530 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029533 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029536 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029539 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029541 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029545 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029553 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029555 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:02.033109 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029558 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029561 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029563 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029566 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029568 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029571 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029573 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029576 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029579 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029581 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029583 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029586 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029589 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029591 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029599 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029603 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029606 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029609 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029611 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029614 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:02.033615 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029617 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029619 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029622 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029624 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029627 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029630 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029632 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029635 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029638 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029641 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029643 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029651 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029654 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029657 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029673 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:02.034176 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.029679 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029832 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029838 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029841 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029844 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029847 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029849 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029852 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029855 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029857 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029860 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029862 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029865 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029867 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029870 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029872 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029875 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029877 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029882 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:02.034556 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029886 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029888 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029891 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029893 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029896 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029899 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029902 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029905 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029907 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029910 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029918 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029921 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029923 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029926 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029929 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029931 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029934 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029936 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029939 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029941 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:02.035089 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029944 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029947 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029949 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029951 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029954 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029956 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029959 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029961 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029964 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029966 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029969 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029972 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029974 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029976 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029979 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029981 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029984 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029986 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029989 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029992 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:02.035626 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029994 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029997 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.029999 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030007 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030010 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030012 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030015 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030017 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030020 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030022 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030025 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030027 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030030 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030032 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030035 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030037 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030040 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030044 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030047 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:02.036133 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030050 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030053 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030056 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030059 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030061 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030064 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030066 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030069 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030071 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030074 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030078 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030082 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030084 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030098 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030101 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030103 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030106 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030115 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030118 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030121 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:02.036586 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030124 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:02.037093 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:02.030126 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:02.037093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.030132 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:53:02.037093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.030273 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 12:53:02.037093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.032813 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 12:53:02.037093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.034630 2577 server.go:1019] "Starting client certificate rotation" Jun 11 12:53:02.037093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.034699 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:53:02.037093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.034745 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:53:02.037821 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.037771 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:53:02.043718 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.043691 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:53:02.055446 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.055418 2577 log.go:25] "Validated CRI v1 runtime API" Jun 11 12:53:02.058621 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.058602 2577 log.go:25] "Validated CRI v1 image API" Jun 11 12:53:02.059458 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.059436 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 12:53:02.062156 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.062129 2577 fs.go:135] Filesystem UUIDs: map[61ea35c2-4d5a-4a65-8f89-ad136681aa09:/dev/nvme0n1p3 71c6a2d8-eb74-4915-b7c9-b319439429c1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 12:53:02.062233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.062155 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 12:53:02.065350 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.065333 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:53:02.067635 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.067519 2577 manager.go:216] Machine: {Timestamp:2026-06-11 12:53:02.066062901 +0000 UTC m=+0.373364524 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100445 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23b023dc9ee646e661959a2534be39 SystemUUID:ec23b023-dc9e-e646-e661-959a2534be39 BootID:a8478d31-fe24-44a9-b127-f45c9c6e9505 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:25:d3:37:60:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:25:d3:37:60:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:cd:d0:99:f1:aa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 12:53:02.067635 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.067633 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 12:53:02.067780 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.067768 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 12:53:02.070768 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.070734 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 12:53:02.070915 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.070771 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-157.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 12:53:02.071647 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.071636 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 12:53:02.071698 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.071650 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 12:53:02.071698 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.071658 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:53:02.071698 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.071687 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:53:02.073026 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.073014 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 12:53:02.077569 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.077555 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:53:02.077927 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.077915 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 12:53:02.077965 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.077949 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 11 12:53:02.077965 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.077963 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 12:53:02.078022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.077975 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 12:53:02.078022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.077995 2577 kubelet.go:398] "Adding apiserver pod source" Jun 11 12:53:02.078022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.078005 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 12:53:02.078411 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.078396 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:53:02.078467 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.078416 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:53:02.082545 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.082529 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 12:53:02.084359 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.084344 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 12:53:02.084408 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.084376 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 12:53:02.085735 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085722 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 12:53:02.085795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085741 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 12:53:02.085795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085748 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 12:53:02.085795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085753 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 12:53:02.085795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085763 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 12:53:02.085795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085770 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 12:53:02.085795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085781 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 12:53:02.085795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085787 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 12:53:02.085980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085805 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 12:53:02.085980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085811 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 12:53:02.085980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085827 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 12:53:02.085980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.085832 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 12:53:02.087846 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.087803 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 12:53:02.088898 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.088876 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 12:53:02.089003 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.088297 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lhjcq" Jun 11 12:53:02.089868 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.089839 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-157.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 12:53:02.089960 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.089906 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 12:53:02.090119 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.090095 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 12:53:02.092447 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.092432 2577 server.go:1268] "Started kubelet" Jun 11 12:53:02.092518 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.092480 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 12:53:02.092580 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.092528 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 12:53:02.092634 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.092595 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 12:53:02.093392 ip-10-0-135-157 systemd[1]: Started Kubernetes Kubelet. Jun 11 12:53:02.093948 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.093599 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 11 12:53:02.096501 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.096484 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lhjcq" Jun 11 12:53:02.097560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.097546 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 12:53:02.099437 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.098285 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-157.ec2.internal.18b807f07ccd2e04 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-157.ec2.internal,UID:ip-10-0-135-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-157.ec2.internal,},FirstTimestamp:2026-06-11 12:53:02.092398084 +0000 UTC m=+0.399699709,LastTimestamp:2026-06-11 12:53:02.092398084 +0000 UTC m=+0.399699709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-157.ec2.internal,}" Jun 11 12:53:02.099698 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.099680 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 12:53:02.104237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.104217 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 12:53:02.104310 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.104236 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 12:53:02.104455 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.104434 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.105078 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105065 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 12:53:02.105193 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105173 2577 factory.go:55] Registering systemd factory Jun 11 12:53:02.105257 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105199 2577 factory.go:223] Registration of the systemd container factory successfully Jun 11 12:53:02.105307 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105275 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 12:53:02.105307 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105288 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 12:53:02.105415 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105389 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 11 12:53:02.105415 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105397 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 11 12:53:02.105552 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105539 2577 factory.go:153] Registering CRI-O factory Jun 11 12:53:02.105617 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105604 2577 factory.go:223] Registration of the crio container factory successfully Jun 11 12:53:02.105693 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105677 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 12:53:02.105747 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105711 2577 factory.go:103] Registering Raw factory Jun 11 12:53:02.105747 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.105727 2577 manager.go:1196] Started watching for new ooms in manager Jun 11 12:53:02.106180 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.106166 2577 manager.go:349] Starting recovery of all containers Jun 11 12:53:02.109840 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.109818 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:02.113334 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.113089 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-157.ec2.internal\" not found" node="ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.117762 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.117735 2577 manager.go:354] Recovery completed Jun 11 12:53:02.122593 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.122578 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:02.125186 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.125169 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:02.125250 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.125213 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:02.125250 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.125226 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:02.125799 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.125787 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 12:53:02.125799 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.125798 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 12:53:02.125888 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.125816 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:53:02.125888 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.125843 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:02.126568 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.126554 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:02.126615 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.126580 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:02.126615 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.126593 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:02.128057 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.128046 2577 policy_none.go:49] "None policy: Start" Jun 11 12:53:02.128104 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.128062 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 12:53:02.128104 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.128072 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 12:53:02.129831 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.129820 2577 policy_none.go:47] "Start" Jun 11 12:53:02.176528 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.176509 2577 manager.go:337] "Starting Device Plugin manager" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.176544 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.176555 2577 server.go:87] "Starting device plugin registration server" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.176841 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.176853 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.177010 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.177097 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.177104 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.177653 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.177724 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.179362 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.180605 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.180645 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.180683 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.180724 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 12:53:02.187401 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.182234 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:02.277293 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.277222 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:02.278446 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.278431 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:02.278512 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.278460 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:02.278512 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.278471 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:02.278512 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.278495 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.281411 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.281395 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal"] Jun 11 12:53:02.281466 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.281457 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:02.282201 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.282186 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:02.282259 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.282214 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:02.282259 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.282223 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:02.284595 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.284583 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:02.284738 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.284722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.284776 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.284757 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:02.285285 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.285266 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:02.285399 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.285297 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:02.285399 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.285312 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:02.285399 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.285296 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:02.285399 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.285344 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:02.285399 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.285357 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:02.286513 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.286498 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.286564 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.286519 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-157.ec2.internal\": node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.287782 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.287766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.287863 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.287792 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:02.288480 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.288464 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:02.288575 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.288491 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:02.288575 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.288503 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:02.300823 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.300792 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.307009 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.306980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6676b675517e243205ee8423f2b1d856-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal\" (UID: \"6676b675517e243205ee8423f2b1d856\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.307009 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.307011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6676b675517e243205ee8423f2b1d856-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal\" (UID: \"6676b675517e243205ee8423f2b1d856\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.307158 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.307027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a72f5a9697ad399eb9691e5a91523da3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-157.ec2.internal\" (UID: \"a72f5a9697ad399eb9691e5a91523da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.307381 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.307366 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-157.ec2.internal\" not found" node="ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.311556 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.311539 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-157.ec2.internal\" not found" node="ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.401876 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.401849 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.407986 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.407959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6676b675517e243205ee8423f2b1d856-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal\" (UID: \"6676b675517e243205ee8423f2b1d856\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.408042 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.407994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a72f5a9697ad399eb9691e5a91523da3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-157.ec2.internal\" (UID: \"a72f5a9697ad399eb9691e5a91523da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.408085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.408042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6676b675517e243205ee8423f2b1d856-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal\" (UID: \"6676b675517e243205ee8423f2b1d856\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.408085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.408049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6676b675517e243205ee8423f2b1d856-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal\" (UID: \"6676b675517e243205ee8423f2b1d856\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.408085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.408069 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6676b675517e243205ee8423f2b1d856-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal\" (UID: \"6676b675517e243205ee8423f2b1d856\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.408173 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.408089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a72f5a9697ad399eb9691e5a91523da3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-157.ec2.internal\" (UID: \"a72f5a9697ad399eb9691e5a91523da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.502251 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.502214 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.603106 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.603028 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.615516 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.615488 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.618649 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:02.618633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" Jun 11 12:53:02.703327 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.703277 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.803800 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.803771 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:02.904327 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:02.904252 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:03.004757 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:03.004727 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:03.034114 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.034085 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 12:53:03.034772 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.034259 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 12:53:03.034772 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.034262 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 12:53:03.105730 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:03.105697 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:03.105730 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.105706 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 12:48:02 +0000 UTC" deadline="2028-03-20 20:25:03.304576724 +0000 UTC" Jun 11 12:53:03.105730 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.105731 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15559h32m0.198849688s" Jun 11 12:53:03.155841 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:03.155774 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6676b675517e243205ee8423f2b1d856.slice/crio-9fad02f24270e2a3be5f334855bca007073753a47077caae9d438e09a5c33c40 WatchSource:0}: Error finding container 9fad02f24270e2a3be5f334855bca007073753a47077caae9d438e09a5c33c40: Status 404 returned error can't find the container with id 9fad02f24270e2a3be5f334855bca007073753a47077caae9d438e09a5c33c40 Jun 11 12:53:03.155996 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:03.155977 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72f5a9697ad399eb9691e5a91523da3.slice/crio-8e84ad1c2d2da6ed6481c3b8aeedd61adbfa0253be9b654e16e89c164695a448 WatchSource:0}: Error finding container 8e84ad1c2d2da6ed6481c3b8aeedd61adbfa0253be9b654e16e89c164695a448: Status 404 returned error can't find the container with id 8e84ad1c2d2da6ed6481c3b8aeedd61adbfa0253be9b654e16e89c164695a448 Jun 11 12:53:03.162867 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.162851 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:53:03.184736 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.184687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" event={"ID":"6676b675517e243205ee8423f2b1d856","Type":"ContainerStarted","Data":"9fad02f24270e2a3be5f334855bca007073753a47077caae9d438e09a5c33c40"} Jun 11 12:53:03.185612 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.185590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" event={"ID":"a72f5a9697ad399eb9691e5a91523da3","Type":"ContainerStarted","Data":"8e84ad1c2d2da6ed6481c3b8aeedd61adbfa0253be9b654e16e89c164695a448"} Jun 11 12:53:03.205873 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:03.205844 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:03.306293 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:03.306253 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:03.406775 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:03.406697 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:03.507213 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:03.507181 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-157.ec2.internal\" not found" Jun 11 12:53:03.558648 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.558616 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:03.574000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.573972 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:03.605218 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.605183 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" Jun 11 12:53:03.617523 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.617484 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:53:03.619027 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.618776 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" Jun 11 12:53:03.627547 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:03.627496 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:53:04.078819 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.078787 2577 apiserver.go:52] "Watching apiserver" Jun 11 12:53:04.085621 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.085594 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 12:53:04.086081 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.086053 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-nk8d6","openshift-ovn-kubernetes/ovnkube-node-t6ptv","kube-system/konnectivity-agent-l2vxz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8","openshift-dns/node-resolver-h79dg","openshift-image-registry/node-ca-tz5pm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal","openshift-multus/multus-m7q4c","openshift-network-diagnostics/network-check-target-jqp4m","openshift-network-operator/iptables-alerter-sscq6","kube-system/global-pull-secret-syncer-gqz86","kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qqhzb","openshift-multus/multus-additional-cni-plugins-wwkw5"] Jun 11 12:53:04.088792 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.088773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.090904 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.090881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.091644 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.091624 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 12:53:04.091759 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.091650 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:53:04.091759 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.091740 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fssc6\"" Jun 11 12:53:04.091874 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.091652 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 12:53:04.093205 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.093155 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.093451 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.093418 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:53:04.093712 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.093567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rfrhg\"" Jun 11 12:53:04.093712 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.093625 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 12:53:04.095503 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.095268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.095503 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.095397 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 12:53:04.095812 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.095785 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 12:53:04.095901 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.095831 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wnpfg\"" Jun 11 12:53:04.097507 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.097470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 12:53:04.097599 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.097525 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jw5x8\"" Jun 11 12:53:04.097655 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.097605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.097906 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.097729 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 12:53:04.097906 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.097760 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 12:53:04.099870 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.099853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.100215 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.100030 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 12:53:04.100215 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.100118 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9nd4p\"" Jun 11 12:53:04.100215 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.100157 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 12:53:04.102170 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.102152 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 12:53:04.102270 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.102153 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 12:53:04.102473 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.102456 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 12:53:04.102550 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.102491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5znb\"" Jun 11 12:53:04.102638 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.102625 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:04.102734 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.102715 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:04.104848 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.104601 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.106617 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.106597 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 12:53:04.108866 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.107518 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 12:53:04.108866 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.107892 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8x9cx\"" Jun 11 12:53:04.109136 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.109117 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.109506 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.109485 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 12:53:04.110196 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.110175 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 12:53:04.110283 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.110198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 12:53:04.110369 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.110354 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 12:53:04.111500 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.111480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:04.111596 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.111551 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:04.112156 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.112139 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 12:53:04.112774 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.112753 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 12:53:04.112937 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.112918 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 12:53:04.113067 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.113048 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 12:53:04.113205 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.113178 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 12:53:04.113270 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.113238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 12:53:04.113367 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.113319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-44sft\"" Jun 11 12:53:04.113870 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.113856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.113952 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.113930 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:04.116111 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.116092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.117149 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c88cb14-0718-49f7-9f29-ac51959cd3c7-agent-certs\") pod \"konnectivity-agent-l2vxz\" (UID: \"6c88cb14-0718-49f7-9f29-ac51959cd3c7\") " pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.117237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-cnibin\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.117237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-lib-modules\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.117237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx4tz\" (UniqueName: \"kubernetes.io/projected/55714e61-ac46-4644-9cdc-d27042b7543e-kube-api-access-kx4tz\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.117450 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-var-lib-kubelet\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.117450 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-kubernetes\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.117450 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbrsj\" (UniqueName: \"kubernetes.io/projected/ff2cff76-4af1-40c0-aeb9-be374405fa23-kube-api-access-dbrsj\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.117450 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-systemd\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.117450 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-sys\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.117450 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-tuned\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.117450 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.117737 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovn-node-metrics-cert\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.117737 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-run\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.117737 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-cni-bin\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.117737 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-env-overrides\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.117737 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-sys-fs\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.117737 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-hosts-file\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.117737 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-tmp-dir\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea637f9e-24ad-4e61-958d-4c190540d9e2-tmp\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117850 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-var-lib-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-host-slash\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.118004 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.117960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-registration-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.118373 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n9mj\" (UniqueName: \"kubernetes.io/projected/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-kube-api-access-5n9mj\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.118373 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:04.118373 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-ovn\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118516 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-iptables-alerter-script\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.118516 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rpfd\" (UniqueName: \"kubernetes.io/projected/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-kube-api-access-2rpfd\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.118516 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.118516 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysctl-d\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.118718 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysctl-conf\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.118718 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-host\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.118718 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-systemd-units\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118718 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-device-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.118718 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mtcp\" (UniqueName: \"kubernetes.io/projected/9251e5a5-1e09-45a2-9ed3-fe3649701a52-kube-api-access-5mtcp\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118718 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118736 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xx8tx\"" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467d8\" (UniqueName: \"kubernetes.io/projected/ea637f9e-24ad-4e61-958d-4c190540d9e2-kube-api-access-467d8\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118755 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-node-log\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovnkube-config\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovnkube-script-lib\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.118980 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-slash\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.118981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-etc-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-socket-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-modprobe-d\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-kubelet\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-log-socket\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-serviceca\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrkj\" (UniqueName: \"kubernetes.io/projected/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-kube-api-access-7vrkj\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-systemd\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-cni-netd\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c88cb14-0718-49f7-9f29-ac51959cd3c7-konnectivity-ca\") pod \"konnectivity-agent-l2vxz\" (UID: \"6c88cb14-0718-49f7-9f29-ac51959cd3c7\") " pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.119348 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-system-cni-dir\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.119866 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-os-release\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.119866 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysconfig\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.119866 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-host\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.119866 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.119441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-run-netns\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.120222 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.120200 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:53:04.139274 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.139256 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mgbql" Jun 11 12:53:04.147478 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.147458 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mgbql" Jun 11 12:53:04.208184 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.207110 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 12:53:04.220461 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysctl-d\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.220461 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysctl-conf\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-host\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-systemd-units\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-hostroot\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-device-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mtcp\" (UniqueName: \"kubernetes.io/projected/9251e5a5-1e09-45a2-9ed3-fe3649701a52-kube-api-access-5mtcp\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-system-cni-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220586 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-host\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-etc-kubernetes\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysctl-d\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysctl-conf\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.220714 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467d8\" (UniqueName: \"kubernetes.io/projected/ea637f9e-24ad-4e61-958d-4c190540d9e2-kube-api-access-467d8\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-node-log\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-systemd-units\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovnkube-config\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovnkube-script-lib\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-device-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-cnibin\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-slash\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-slash\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-etc-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.220974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b31a102-de4c-457c-883e-a8013818e1a5-cni-binary-copy\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-socket-dir-parent\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-k8s-cni-cncf-io\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-socket-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-modprobe-d\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-kubelet\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.221297 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-log-socket\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221123 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-etc-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221245 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-modprobe-d\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-kubelet\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-kubelet\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-socket-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-log-socket\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-serviceca\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrkj\" (UniqueName: \"kubernetes.io/projected/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-kube-api-access-7vrkj\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovnkube-config\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221491 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-conf-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-node-log\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221482 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-multus-certs\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-systemd\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222090 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-cni-netd\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-systemd\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c88cb14-0718-49f7-9f29-ac51959cd3c7-konnectivity-ca\") pod \"konnectivity-agent-l2vxz\" (UID: \"6c88cb14-0718-49f7-9f29-ac51959cd3c7\") " pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-cni-netd\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-system-cni-dir\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-serviceca\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovnkube-script-lib\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-os-release\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.221995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-system-cni-dir\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-os-release\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysconfig\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-host\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-run-netns\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-kubelet-config\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-sysconfig\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222162 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-host\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79h26\" (UniqueName: \"kubernetes.io/projected/3b31a102-de4c-457c-883e-a8013818e1a5-kube-api-access-79h26\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.222896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-run-netns\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c88cb14-0718-49f7-9f29-ac51959cd3c7-agent-certs\") pod \"konnectivity-agent-l2vxz\" (UID: \"6c88cb14-0718-49f7-9f29-ac51959cd3c7\") " pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-cnibin\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-lib-modules\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-dbus\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-cnibin\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx4tz\" (UniqueName: \"kubernetes.io/projected/55714e61-ac46-4644-9cdc-d27042b7543e-kube-api-access-kx4tz\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-var-lib-kubelet\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6c88cb14-0718-49f7-9f29-ac51959cd3c7-konnectivity-ca\") pod \"konnectivity-agent-l2vxz\" (UID: \"6c88cb14-0718-49f7-9f29-ac51959cd3c7\") " pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-kubernetes\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbrsj\" (UniqueName: \"kubernetes.io/projected/ff2cff76-4af1-40c0-aeb9-be374405fa23-kube-api-access-dbrsj\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-lib-modules\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-var-lib-kubelet\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-systemd\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-systemd\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.223721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-sys\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222549 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-tuned\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-kubernetes\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovn-node-metrics-cert\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222684 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-sys\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-cni-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-run\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea637f9e-24ad-4e61-958d-4c190540d9e2-run\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-cni-bin\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-host-cni-bin\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-env-overrides\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5shht\" (UniqueName: \"kubernetes.io/projected/5e71a2cf-a469-4136-bae5-eba4685d3086-kube-api-access-5shht\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-netns\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.222981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-cni-bin\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-cni-multus\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.224515 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b31a102-de4c-457c-883e-a8013818e1a5-multus-daemon-config\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-sys-fs\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-hosts-file\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-tmp-dir\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223196 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-sys-fs\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-hosts-file\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea637f9e-24ad-4e61-958d-4c190540d9e2-tmp\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-var-lib-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9251e5a5-1e09-45a2-9ed3-fe3649701a52-env-overrides\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-host-slash\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-registration-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n9mj\" (UniqueName: \"kubernetes.io/projected/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-kube-api-access-5n9mj\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.225390 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-host-slash\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff2cff76-4af1-40c0-aeb9-be374405fa23-registration-dir\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-ovn\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-os-release\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-ovn\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-var-lib-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-tmp-dir\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-iptables-alerter-script\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rpfd\" (UniqueName: \"kubernetes.io/projected/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-kube-api-access-2rpfd\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9251e5a5-1e09-45a2-9ed3-fe3649701a52-run-openvswitch\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55714e61-ac46-4644-9cdc-d27042b7543e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.223935 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55714e61-ac46-4644-9cdc-d27042b7543e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.226220 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.224236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-iptables-alerter-script\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.226907 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.226750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea637f9e-24ad-4e61-958d-4c190540d9e2-tmp\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.226907 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.226790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea637f9e-24ad-4e61-958d-4c190540d9e2-etc-tuned\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.227103 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.226906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9251e5a5-1e09-45a2-9ed3-fe3649701a52-ovn-node-metrics-cert\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.227103 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.227043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6c88cb14-0718-49f7-9f29-ac51959cd3c7-agent-certs\") pod \"konnectivity-agent-l2vxz\" (UID: \"6c88cb14-0718-49f7-9f29-ac51959cd3c7\") " pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.229500 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.229470 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:04.229500 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.229498 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:04.229683 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.229512 2577 projected.go:196] Error preparing data for projected volume kube-api-access-zrzhf for pod openshift-network-diagnostics/network-check-target-jqp4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:04.229683 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.229631 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf podName:a1baaaed-88ee-4f1a-8749-d4d292b354c0 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:04.729601007 +0000 UTC m=+3.036902630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zrzhf" (UniqueName: "kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf") pod "network-check-target-jqp4m" (UID: "a1baaaed-88ee-4f1a-8749-d4d292b354c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:04.232021 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.231990 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbrsj\" (UniqueName: \"kubernetes.io/projected/ff2cff76-4af1-40c0-aeb9-be374405fa23-kube-api-access-dbrsj\") pod \"aws-ebs-csi-driver-node-9hnt8\" (UID: \"ff2cff76-4af1-40c0-aeb9-be374405fa23\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.232407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.232382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rpfd\" (UniqueName: \"kubernetes.io/projected/f0e0ccaf-60f7-47f6-9988-1eb6f9590692-kube-api-access-2rpfd\") pod \"iptables-alerter-sscq6\" (UID: \"f0e0ccaf-60f7-47f6-9988-1eb6f9590692\") " pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.232575 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.232518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx4tz\" (UniqueName: \"kubernetes.io/projected/55714e61-ac46-4644-9cdc-d27042b7543e-kube-api-access-kx4tz\") pod \"multus-additional-cni-plugins-wwkw5\" (UID: \"55714e61-ac46-4644-9cdc-d27042b7543e\") " pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.233133 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.233112 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrkj\" (UniqueName: \"kubernetes.io/projected/54faeadc-5eee-405d-a2b4-e1fb58b9bcd0-kube-api-access-7vrkj\") pod \"node-ca-tz5pm\" (UID: \"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0\") " pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.233597 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.233577 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-467d8\" (UniqueName: \"kubernetes.io/projected/ea637f9e-24ad-4e61-958d-4c190540d9e2-kube-api-access-467d8\") pod \"tuned-qqhzb\" (UID: \"ea637f9e-24ad-4e61-958d-4c190540d9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.234434 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.234404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n9mj\" (UniqueName: \"kubernetes.io/projected/1155a92d-ee4a-4f76-a8b3-73b4392e8f86-kube-api-access-5n9mj\") pod \"node-resolver-h79dg\" (UID: \"1155a92d-ee4a-4f76-a8b3-73b4392e8f86\") " pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.234528 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.234501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mtcp\" (UniqueName: \"kubernetes.io/projected/9251e5a5-1e09-45a2-9ed3-fe3649701a52-kube-api-access-5mtcp\") pod \"ovnkube-node-t6ptv\" (UID: \"9251e5a5-1e09-45a2-9ed3-fe3649701a52\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.324754 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.324727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:04.324927 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.324762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-dbus\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.324927 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.324780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.324927 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.324841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-cni-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.324927 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.324888 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.324928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-cni-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.324935 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret podName:c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:04.824919981 +0000 UTC m=+3.132221592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret") pod "global-pull-secret-syncer-gqz86" (UID: "c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.324984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-dbus\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.325017 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5shht\" (UniqueName: \"kubernetes.io/projected/5e71a2cf-a469-4136-bae5-eba4685d3086-kube-api-access-5shht\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-netns\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-cni-bin\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.325095 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:04.825077562 +0000 UTC m=+3.132379188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-netns\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-cni-multus\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-cni-bin\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b31a102-de4c-457c-883e-a8013818e1a5-multus-daemon-config\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-cni-multus\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-os-release\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-hostroot\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-system-cni-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-etc-kubernetes\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325268 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-hostroot\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325293 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-system-cni-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325304 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-etc-kubernetes\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325326 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-os-release\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-cnibin\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b31a102-de4c-457c-883e-a8013818e1a5-cni-binary-copy\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-socket-dir-parent\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-cnibin\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-k8s-cni-cncf-io\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325471 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-socket-dir-parent\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-kubelet\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.325564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-conf-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325505 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-var-lib-kubelet\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-k8s-cni-cncf-io\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-multus-certs\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-kubelet-config\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79h26\" (UniqueName: \"kubernetes.io/projected/3b31a102-de4c-457c-883e-a8013818e1a5-kube-api-access-79h26\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b31a102-de4c-457c-883e-a8013818e1a5-multus-daemon-config\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-multus-conf-dir\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b31a102-de4c-457c-883e-a8013818e1a5-host-run-multus-certs\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-kubelet-config\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.326275 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.325925 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b31a102-de4c-457c-883e-a8013818e1a5-cni-binary-copy\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.333764 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.333705 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79h26\" (UniqueName: \"kubernetes.io/projected/3b31a102-de4c-457c-883e-a8013818e1a5-kube-api-access-79h26\") pod \"multus-m7q4c\" (UID: \"3b31a102-de4c-457c-883e-a8013818e1a5\") " pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.334749 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.334717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5shht\" (UniqueName: \"kubernetes.io/projected/5e71a2cf-a469-4136-bae5-eba4685d3086-kube-api-access-5shht\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:04.400960 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.400928 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sscq6" Jun 11 12:53:04.410110 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.410081 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" Jun 11 12:53:04.418843 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.418818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:04.423619 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.423594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" Jun 11 12:53:04.430247 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.430226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h79dg" Jun 11 12:53:04.435812 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.435792 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tz5pm" Jun 11 12:53:04.442542 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.442519 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" Jun 11 12:53:04.449191 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.449172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:04.454163 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.454134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m7q4c" Jun 11 12:53:04.534921 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.534887 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:04.593485 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.593399 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:04.829636 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.829597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:04.829837 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.829644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:04.829837 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:04.829707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:04.829837 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.829763 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:04.829837 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.829810 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:04.830032 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.829835 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:05.829816785 +0000 UTC m=+4.137118398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:04.830032 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.829878 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret podName:c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:05.82986699 +0000 UTC m=+4.137168605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret") pod "global-pull-secret-syncer-gqz86" (UID: "c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:04.830032 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.829896 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:04.830032 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.829914 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:04.830032 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.829944 2577 projected.go:196] Error preparing data for projected volume kube-api-access-zrzhf for pod openshift-network-diagnostics/network-check-target-jqp4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:04.830032 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:04.830000 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf podName:a1baaaed-88ee-4f1a-8749-d4d292b354c0 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:05.829981745 +0000 UTC m=+4.137283370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrzhf" (UniqueName: "kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf") pod "network-check-target-jqp4m" (UID: "a1baaaed-88ee-4f1a-8749-d4d292b354c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:05.027815 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.027785 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9251e5a5_1e09_45a2_9ed3_fe3649701a52.slice/crio-82a60d8f8884f3cae663b8b1ae13289c1c879b43de6bbd08a0b08c93a3dd4f2e WatchSource:0}: Error finding container 82a60d8f8884f3cae663b8b1ae13289c1c879b43de6bbd08a0b08c93a3dd4f2e: Status 404 returned error can't find the container with id 82a60d8f8884f3cae663b8b1ae13289c1c879b43de6bbd08a0b08c93a3dd4f2e Jun 11 12:53:05.028371 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.028328 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b31a102_de4c_457c_883e_a8013818e1a5.slice/crio-8597dfbfc19282182bb8b29288180e91c7b513ddff96251d7018605378c9be55 WatchSource:0}: Error finding container 8597dfbfc19282182bb8b29288180e91c7b513ddff96251d7018605378c9be55: Status 404 returned error can't find the container with id 8597dfbfc19282182bb8b29288180e91c7b513ddff96251d7018605378c9be55 Jun 11 12:53:05.029251 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.029153 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea637f9e_24ad_4e61_958d_4c190540d9e2.slice/crio-1070ba85e1a18ca43015a8fd11f288d7674c5a956b71899e8d4920a4de16bca1 WatchSource:0}: Error finding container 1070ba85e1a18ca43015a8fd11f288d7674c5a956b71899e8d4920a4de16bca1: Status 404 returned error can't find the container with id 1070ba85e1a18ca43015a8fd11f288d7674c5a956b71899e8d4920a4de16bca1 Jun 11 12:53:05.056227 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.056198 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e0ccaf_60f7_47f6_9988_1eb6f9590692.slice/crio-9e26f75b3758782325506cc3897642a0d8e4c5ace7cd4c0e63aa7108c2510463 WatchSource:0}: Error finding container 9e26f75b3758782325506cc3897642a0d8e4c5ace7cd4c0e63aa7108c2510463: Status 404 returned error can't find the container with id 9e26f75b3758782325506cc3897642a0d8e4c5ace7cd4c0e63aa7108c2510463 Jun 11 12:53:05.056798 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.056760 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2cff76_4af1_40c0_aeb9_be374405fa23.slice/crio-9e4ada066546c104c6b85c73633f4d9cb79b1a79b84442e5de998cfa1837c945 WatchSource:0}: Error finding container 9e4ada066546c104c6b85c73633f4d9cb79b1a79b84442e5de998cfa1837c945: Status 404 returned error can't find the container with id 9e4ada066546c104c6b85c73633f4d9cb79b1a79b84442e5de998cfa1837c945 Jun 11 12:53:05.058262 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.058235 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54faeadc_5eee_405d_a2b4_e1fb58b9bcd0.slice/crio-fe4a879afe41abfe71e3f9ed6cece984fea6ef05d2bed1401292a026cdc857e3 WatchSource:0}: Error finding container fe4a879afe41abfe71e3f9ed6cece984fea6ef05d2bed1401292a026cdc857e3: Status 404 returned error can't find the container with id fe4a879afe41abfe71e3f9ed6cece984fea6ef05d2bed1401292a026cdc857e3 Jun 11 12:53:05.059971 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.059761 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c88cb14_0718_49f7_9f29_ac51959cd3c7.slice/crio-91dae02a87eb345280322f695cec148abdaa0b0d5c0b3347780bffd733389598 WatchSource:0}: Error finding container 91dae02a87eb345280322f695cec148abdaa0b0d5c0b3347780bffd733389598: Status 404 returned error can't find the container with id 91dae02a87eb345280322f695cec148abdaa0b0d5c0b3347780bffd733389598 Jun 11 12:53:05.061819 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.061728 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55714e61_ac46_4644_9cdc_d27042b7543e.slice/crio-11b4306cac906d37950931440a84e37253b73e68691606b83a20bdc94af88455 WatchSource:0}: Error finding container 11b4306cac906d37950931440a84e37253b73e68691606b83a20bdc94af88455: Status 404 returned error can't find the container with id 11b4306cac906d37950931440a84e37253b73e68691606b83a20bdc94af88455 Jun 11 12:53:05.062847 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:05.062824 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1155a92d_ee4a_4f76_a8b3_73b4392e8f86.slice/crio-aabb4b79bc31fa5e4ec9d56ad5e2f312f32c5ab5afcc94a68935be971de7cb86 WatchSource:0}: Error finding container aabb4b79bc31fa5e4ec9d56ad5e2f312f32c5ab5afcc94a68935be971de7cb86: Status 404 returned error can't find the container with id aabb4b79bc31fa5e4ec9d56ad5e2f312f32c5ab5afcc94a68935be971de7cb86 Jun 11 12:53:05.151069 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.150886 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:48:04 +0000 UTC" deadline="2028-02-26 19:02:03.671529218 +0000 UTC" Jun 11 12:53:05.151069 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.151068 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15006h8m58.52046501s" Jun 11 12:53:05.182007 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.181977 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:05.182007 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.182005 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:05.182192 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.182089 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:05.182229 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.182209 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:05.195144 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.195106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tz5pm" event={"ID":"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0","Type":"ContainerStarted","Data":"fe4a879afe41abfe71e3f9ed6cece984fea6ef05d2bed1401292a026cdc857e3"} Jun 11 12:53:05.196319 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.196292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" event={"ID":"ff2cff76-4af1-40c0-aeb9-be374405fa23","Type":"ContainerStarted","Data":"9e4ada066546c104c6b85c73633f4d9cb79b1a79b84442e5de998cfa1837c945"} Jun 11 12:53:05.198211 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.198187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" event={"ID":"a72f5a9697ad399eb9691e5a91523da3","Type":"ContainerStarted","Data":"ab13f46e9f4db8e012fb32fce6d8bc6203cc8cb1a20b1f1e21e2a10d3abd2b10"} Jun 11 12:53:05.199174 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.199151 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h79dg" event={"ID":"1155a92d-ee4a-4f76-a8b3-73b4392e8f86","Type":"ContainerStarted","Data":"aabb4b79bc31fa5e4ec9d56ad5e2f312f32c5ab5afcc94a68935be971de7cb86"} Jun 11 12:53:05.202368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.202349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2vxz" event={"ID":"6c88cb14-0718-49f7-9f29-ac51959cd3c7","Type":"ContainerStarted","Data":"91dae02a87eb345280322f695cec148abdaa0b0d5c0b3347780bffd733389598"} Jun 11 12:53:05.203396 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.203378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sscq6" event={"ID":"f0e0ccaf-60f7-47f6-9988-1eb6f9590692","Type":"ContainerStarted","Data":"9e26f75b3758782325506cc3897642a0d8e4c5ace7cd4c0e63aa7108c2510463"} Jun 11 12:53:05.205621 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.205603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" event={"ID":"ea637f9e-24ad-4e61-958d-4c190540d9e2","Type":"ContainerStarted","Data":"1070ba85e1a18ca43015a8fd11f288d7674c5a956b71899e8d4920a4de16bca1"} Jun 11 12:53:05.206605 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.206585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m7q4c" event={"ID":"3b31a102-de4c-457c-883e-a8013818e1a5","Type":"ContainerStarted","Data":"8597dfbfc19282182bb8b29288180e91c7b513ddff96251d7018605378c9be55"} Jun 11 12:53:05.209600 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.209581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"82a60d8f8884f3cae663b8b1ae13289c1c879b43de6bbd08a0b08c93a3dd4f2e"} Jun 11 12:53:05.211597 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.211576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerStarted","Data":"11b4306cac906d37950931440a84e37253b73e68691606b83a20bdc94af88455"} Jun 11 12:53:05.213882 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.213844 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-157.ec2.internal" podStartSLOduration=2.213833315 podStartE2EDuration="2.213833315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:05.213484188 +0000 UTC m=+3.520785820" watchObservedRunningTime="2026-06-11 12:53:05.213833315 +0000 UTC m=+3.521134945" Jun 11 12:53:05.838388 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.838323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:05.838388 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.838373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:05.838564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:05.838431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:05.838611 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.838585 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:05.838611 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.838606 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:05.838701 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.838618 2577 projected.go:196] Error preparing data for projected volume kube-api-access-zrzhf for pod openshift-network-diagnostics/network-check-target-jqp4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:05.838701 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.838696 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf podName:a1baaaed-88ee-4f1a-8749-d4d292b354c0 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:07.838674833 +0000 UTC m=+6.145976461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrzhf" (UniqueName: "kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf") pod "network-check-target-jqp4m" (UID: "a1baaaed-88ee-4f1a-8749-d4d292b354c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:05.839124 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.839106 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:05.839180 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.839163 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:07.839146872 +0000 UTC m=+6.146448487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:05.839238 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.839225 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:05.839277 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:05.839266 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret podName:c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:07.839254508 +0000 UTC m=+6.146556120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret") pod "global-pull-secret-syncer-gqz86" (UID: "c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:06.152322 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:06.152221 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:48:04 +0000 UTC" deadline="2027-11-25 03:26:49.731069698 +0000 UTC" Jun 11 12:53:06.152322 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:06.152265 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12758h33m43.578808702s" Jun 11 12:53:06.182417 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:06.181788 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:06.182417 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:06.181935 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:06.230076 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:06.230036 2577 generic.go:356] "Generic (PLEG): container finished" podID="6676b675517e243205ee8423f2b1d856" containerID="f56412dbe4d8b7db5153dea76c22029f83b934b5556dceafb3938cc5ff00e9ec" exitCode=0 Jun 11 12:53:06.230945 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:06.230719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" event={"ID":"6676b675517e243205ee8423f2b1d856","Type":"ContainerDied","Data":"f56412dbe4d8b7db5153dea76c22029f83b934b5556dceafb3938cc5ff00e9ec"} Jun 11 12:53:07.181491 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:07.181455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:07.181491 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:07.181476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:07.182076 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.181584 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:07.182076 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.182011 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:07.246991 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:07.246955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" event={"ID":"6676b675517e243205ee8423f2b1d856","Type":"ContainerStarted","Data":"12bfd8af8805657f2062fc3f0b9986a89650da121ad40d4934fca7dfffff3ea1"} Jun 11 12:53:07.857673 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:07.857621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:07.857893 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:07.857698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:07.857893 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:07.857761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:07.857893 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.857880 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:07.858060 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.857944 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:11.857924311 +0000 UTC m=+10.165225936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:07.858376 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.858354 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:07.858472 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.858412 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret podName:c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:11.858396257 +0000 UTC m=+10.165697885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret") pod "global-pull-secret-syncer-gqz86" (UID: "c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:07.858538 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.858492 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:07.858538 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.858511 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:07.858538 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.858523 2577 projected.go:196] Error preparing data for projected volume kube-api-access-zrzhf for pod openshift-network-diagnostics/network-check-target-jqp4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:07.858708 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:07.858580 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf podName:a1baaaed-88ee-4f1a-8749-d4d292b354c0 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:11.85854893 +0000 UTC m=+10.165850559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrzhf" (UniqueName: "kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf") pod "network-check-target-jqp4m" (UID: "a1baaaed-88ee-4f1a-8749-d4d292b354c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:08.183407 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:08.182986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:08.183407 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:08.183095 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:09.181681 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:09.181624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:09.181853 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:09.181769 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:09.182292 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:09.182161 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:09.182292 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:09.182251 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:10.181612 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:10.181573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:10.182047 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:10.181746 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:11.181474 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:11.181443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:11.181644 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:11.181492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:11.181644 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.181583 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:11.182075 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.181713 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:11.894435 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:11.894387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:11.894629 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:11.894442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:11.894629 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:11.894487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:11.894780 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894642 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:11.894780 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894681 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:11.894780 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894695 2577 projected.go:196] Error preparing data for projected volume kube-api-access-zrzhf for pod openshift-network-diagnostics/network-check-target-jqp4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:11.894780 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894753 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf podName:a1baaaed-88ee-4f1a-8749-d4d292b354c0 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:19.894734902 +0000 UTC m=+18.202036517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrzhf" (UniqueName: "kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf") pod "network-check-target-jqp4m" (UID: "a1baaaed-88ee-4f1a-8749-d4d292b354c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:11.894983 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894833 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:11.894983 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894867 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:19.89485501 +0000 UTC m=+18.202156621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:11.894983 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894923 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:11.894983 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:11.894954 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret podName:c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:19.894943978 +0000 UTC m=+18.202245603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret") pod "global-pull-secret-syncer-gqz86" (UID: "c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:12.185864 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:12.185285 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:12.185864 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:12.185406 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:13.182196 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:13.181789 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:13.182196 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:13.181918 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:13.182196 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:13.182000 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:13.182196 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:13.182086 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:14.182021 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:14.181939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:14.182500 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:14.182084 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:15.181794 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:15.181754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:15.181959 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:15.181754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:15.181959 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:15.181893 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:15.182099 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:15.181974 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:16.181375 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:16.181332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:16.181561 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:16.181484 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:17.181943 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:17.181911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:17.182376 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:17.181911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:17.182376 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:17.182060 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:17.182376 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:17.182137 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:18.181290 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:18.181250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:18.181476 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:18.181401 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:19.181337 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:19.181306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:19.181337 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:19.181336 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:19.181767 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.181427 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:19.181767 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.181545 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:19.955585 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:19.955543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:19.955781 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:19.955603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:19.955781 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:19.955657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:19.955781 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955734 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:19.955781 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955766 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:19.955973 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955792 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:19.955973 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955816 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:19.955973 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955831 2577 projected.go:196] Error preparing data for projected volume kube-api-access-zrzhf for pod openshift-network-diagnostics/network-check-target-jqp4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:19.955973 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955801 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret podName:c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:35.955783909 +0000 UTC m=+34.263085525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret") pod "global-pull-secret-syncer-gqz86" (UID: "c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:19.955973 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955926 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:35.955887717 +0000 UTC m=+34.263189342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:19.955973 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:19.955950 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf podName:a1baaaed-88ee-4f1a-8749-d4d292b354c0 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:35.955939087 +0000 UTC m=+34.263240702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrzhf" (UniqueName: "kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf") pod "network-check-target-jqp4m" (UID: "a1baaaed-88ee-4f1a-8749-d4d292b354c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:20.181812 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:20.181779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:20.182281 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:20.181922 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:21.181921 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:21.181882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:21.182471 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:21.181882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:21.182471 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:21.182005 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:21.182471 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:21.182083 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:22.181914 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:22.181878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:22.182324 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:22.181997 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:23.181202 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:23.181163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:23.181397 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:23.181165 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:23.181397 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:23.181309 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:23.181491 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:23.181394 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:24.181326 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.181142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:24.182184 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:24.181451 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:24.282611 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.282574 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h79dg" event={"ID":"1155a92d-ee4a-4f76-a8b3-73b4392e8f86","Type":"ContainerStarted","Data":"02335f88c46c605e03ec5e6a759360c08e2bb063b223cfa8ed5e43be42cb3bc8"} Jun 11 12:53:24.284085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.284057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l2vxz" event={"ID":"6c88cb14-0718-49f7-9f29-ac51959cd3c7","Type":"ContainerStarted","Data":"5b6a323dac21f3daa0e8393db77ea1f38d0660a658110c5923711934ffdcbdec"} Jun 11 12:53:24.285463 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.285436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" event={"ID":"ea637f9e-24ad-4e61-958d-4c190540d9e2","Type":"ContainerStarted","Data":"5c95800f282c83f7979ddaad0d51fed6f78edd65ec701e1e511ac97d4035ed36"} Jun 11 12:53:24.286822 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.286801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m7q4c" event={"ID":"3b31a102-de4c-457c-883e-a8013818e1a5","Type":"ContainerStarted","Data":"107ec226bef535ae59ea8c4385bd07c9d731dc3b6632bcbca3bb1c60098ed5ea"} Jun 11 12:53:24.288310 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.288294 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 12:53:24.288634 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.288615 2577 generic.go:356] "Generic (PLEG): container finished" podID="9251e5a5-1e09-45a2-9ed3-fe3649701a52" containerID="5425e6ede4a5ae46ab323c4628d2c31701b96d6d5f5fc88cd84b0595db24cc67" exitCode=1 Jun 11 12:53:24.288707 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.288691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerDied","Data":"5425e6ede4a5ae46ab323c4628d2c31701b96d6d5f5fc88cd84b0595db24cc67"} Jun 11 12:53:24.288780 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.288764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"4c9bb86d93b33c4f8717ee67278efa2933f14b1d6b2ed34528e5e102f663d0c7"} Jun 11 12:53:24.290104 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.290080 2577 generic.go:356] "Generic (PLEG): container finished" podID="55714e61-ac46-4644-9cdc-d27042b7543e" containerID="4d86ce577593ea6c2751451ddd86baca3901194f707a8af10daecf15acf3af5b" exitCode=0 Jun 11 12:53:24.290202 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.290145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerDied","Data":"4d86ce577593ea6c2751451ddd86baca3901194f707a8af10daecf15acf3af5b"} Jun 11 12:53:24.291880 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.291823 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tz5pm" event={"ID":"54faeadc-5eee-405d-a2b4-e1fb58b9bcd0","Type":"ContainerStarted","Data":"e9b7c42461cbad005957def8207b6d9429a75229f6411f18102fa02716e3b551"} Jun 11 12:53:24.293503 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.293485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" event={"ID":"ff2cff76-4af1-40c0-aeb9-be374405fa23","Type":"ContainerStarted","Data":"f92ae52b838c57eda7524229cc0f21e89276cb774449a8c6e2288dcdeba0f6fe"} Jun 11 12:53:24.302500 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.302450 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-157.ec2.internal" podStartSLOduration=21.302417467 podStartE2EDuration="21.302417467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:07.265227938 +0000 UTC m=+5.572529572" watchObservedRunningTime="2026-06-11 12:53:24.302417467 +0000 UTC m=+22.609719102" Jun 11 12:53:24.303181 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.303147 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h79dg" podStartSLOduration=3.549602587 podStartE2EDuration="22.30313516s" totalImagesPullingTime="18.753532573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:24.302520088 +0000 UTC m=+22.609821722" watchObservedRunningTime="2026-06-11 12:53:24.30313516 +0000 UTC m=+22.610436793" Jun 11 12:53:24.319398 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.319353 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m7q4c" podStartSLOduration=3.530510531 podStartE2EDuration="22.319336281s" totalImagesPullingTime="18.78882575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:24.319069098 +0000 UTC m=+22.626370732" watchObservedRunningTime="2026-06-11 12:53:24.319336281 +0000 UTC m=+22.626637914" Jun 11 12:53:24.354340 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.354261 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l2vxz" podStartSLOduration=8.16207414 podStartE2EDuration="22.354243594s" totalImagesPullingTime="14.192169454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:24.336109614 +0000 UTC m=+22.643411248" watchObservedRunningTime="2026-06-11 12:53:24.354243594 +0000 UTC m=+22.661545228" Jun 11 12:53:24.354618 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.354579 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tz5pm" podStartSLOduration=3.595481018 podStartE2EDuration="22.354569038s" totalImagesPullingTime="18.75908802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:24.353439403 +0000 UTC m=+22.660741027" watchObservedRunningTime="2026-06-11 12:53:24.354569038 +0000 UTC m=+22.661870786" Jun 11 12:53:24.375560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.375514 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qqhzb" podStartSLOduration=3.604789029 podStartE2EDuration="22.375497622s" totalImagesPullingTime="18.770708593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:24.375232932 +0000 UTC m=+22.682534556" watchObservedRunningTime="2026-06-11 12:53:24.375497622 +0000 UTC m=+22.682799285" Jun 11 12:53:24.453086 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.452901 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:24.531012 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:24.530981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:25.181896 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.181869 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:25.182600 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:25.182006 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:25.182600 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.182384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:25.182600 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:25.182486 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:25.298176 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.298143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sscq6" event={"ID":"f0e0ccaf-60f7-47f6-9988-1eb6f9590692","Type":"ContainerStarted","Data":"ecca6c4cc9b0db205d162f9903d75507c78432d368d3f4d277cefd9e0c02b8fa"} Jun 11 12:53:25.301472 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.301450 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 12:53:25.302368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.302339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"40fab0e6166355539ad56ac58fb872bfb91e28189a425a29492fb7ae600f52a3"} Jun 11 12:53:25.302438 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.302421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"f9207289ee4ddb1da2aeb68b9da0e28fba549c0700f05b7c72d453c130766aef"} Jun 11 12:53:25.302485 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.302472 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"487740144d0b0e469b6c1e04aa9e93b7cc788b46447dfddae827a6168c024e40"} Jun 11 12:53:25.302537 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.302525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"9d5bf2d7625822a57dca96f39805a4e7a7c7463c6aef2e29dd8cc221305e1fef"} Jun 11 12:53:25.313805 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.313754 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sscq6" podStartSLOduration=4.553017548 podStartE2EDuration="23.313732214s" totalImagesPullingTime="18.760714666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:25.313559999 +0000 UTC m=+23.620861635" watchObservedRunningTime="2026-06-11 12:53:25.313732214 +0000 UTC m=+23.621033847" Jun 11 12:53:25.433787 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.433687 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:25.534237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.534201 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:25.732511 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:25.732489 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 12:53:26.181188 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:26.181153 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:26.181356 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:26.181302 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:26.190899 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:26.190798 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T12:53:25.732505515Z","UUID":"a7da3be2-ec40-4e88-87a1-164ef3eb04fb","Handler":null,"Name":"","Endpoint":""} Jun 11 12:53:26.196251 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:26.196186 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 12:53:26.196251 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:26.196233 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 12:53:26.306913 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:26.306873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" event={"ID":"ff2cff76-4af1-40c0-aeb9-be374405fa23","Type":"ContainerStarted","Data":"d5ae70d31d009465924d662eac1046369dc62cc669a89d2fb7e68876a2ab124b"} Jun 11 12:53:27.181461 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:27.181202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:27.181639 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:27.181202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:27.181639 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:27.181578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:27.181747 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:27.181639 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:27.312130 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:27.312090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" event={"ID":"ff2cff76-4af1-40c0-aeb9-be374405fa23","Type":"ContainerStarted","Data":"02902c9d663f31e501b60682feb988c87fa18bd5b2f71b1c6459b6c318e55206"} Jun 11 12:53:27.315517 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:27.315496 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 12:53:27.315877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:27.315855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"f60c0779626594626885ccef64fd1dace1203e253802ba1455f7120566b24d56"} Jun 11 12:53:27.479845 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:27.479761 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:28.181287 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:28.181253 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:28.181515 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:28.181369 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:28.320065 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:28.320037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerStarted","Data":"479f3ca926d2d6ba7a52a1fde07eff2a87637e3faee10fbd7242891320ccf32d"} Jun 11 12:53:28.598414 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:28.598384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:28.698603 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:28.698567 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:28.763448 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:28.763399 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:28.764272 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:28.764252 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:28.780240 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:28.780194 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hnt8" podStartSLOduration=5.797564374 podStartE2EDuration="26.780177766s" totalImagesPullingTime="20.982613392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:27.330162762 +0000 UTC m=+25.637464399" watchObservedRunningTime="2026-06-11 12:53:28.780177766 +0000 UTC m=+27.087479400" Jun 11 12:53:29.182042 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.181764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:29.182042 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.181765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:29.182199 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:29.182045 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:29.182199 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:29.182109 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:29.325254 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.325226 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 12:53:29.325949 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.325586 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"22715e9776e8d0c3cd4fbe160bde32fdfc63129d60dd5ee4ca466792686d53b7"} Jun 11 12:53:29.325949 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.325842 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:29.326077 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.326062 2577 scope.go:117] "RemoveContainer" containerID="5425e6ede4a5ae46ab323c4628d2c31701b96d6d5f5fc88cd84b0595db24cc67" Jun 11 12:53:29.327602 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.327579 2577 generic.go:356] "Generic (PLEG): container finished" podID="55714e61-ac46-4644-9cdc-d27042b7543e" containerID="479f3ca926d2d6ba7a52a1fde07eff2a87637e3faee10fbd7242891320ccf32d" exitCode=0 Jun 11 12:53:29.327705 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.327649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerDied","Data":"479f3ca926d2d6ba7a52a1fde07eff2a87637e3faee10fbd7242891320ccf32d"} Jun 11 12:53:29.328543 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.328468 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l2vxz" Jun 11 12:53:29.343192 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.343167 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:29.411063 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.410995 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:29.551483 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.551394 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:29.652489 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:29.652448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:30.181869 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.181849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:30.181993 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:30.181972 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:30.333976 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.333935 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 12:53:30.334482 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.334452 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" event={"ID":"9251e5a5-1e09-45a2-9ed3-fe3649701a52","Type":"ContainerStarted","Data":"3cf92d054ff23ad7becef110f1935d09b4c024eb8739edcffe981ae5dc34b572"} Jun 11 12:53:30.334879 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.334835 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:30.334989 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.334899 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:30.337008 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.336978 2577 generic.go:356] "Generic (PLEG): container finished" podID="55714e61-ac46-4644-9cdc-d27042b7543e" containerID="1306d63d3653ec214661c5a94112491c9e9eb0d19e38f57ee58cef59c71aa883" exitCode=0 Jun 11 12:53:30.337107 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.337017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerDied","Data":"1306d63d3653ec214661c5a94112491c9e9eb0d19e38f57ee58cef59c71aa883"} Jun 11 12:53:30.352133 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.352076 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:53:30.371963 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.371915 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" podStartSLOduration=9.550074786 podStartE2EDuration="28.371900996s" totalImagesPullingTime="18.82182621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:30.371411418 +0000 UTC m=+28.678713072" watchObservedRunningTime="2026-06-11 12:53:30.371900996 +0000 UTC m=+28.679202630" Jun 11 12:53:30.968876 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.968788 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqz86"] Jun 11 12:53:30.969027 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.968930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:30.969087 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:30.969045 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:30.972256 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.972214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nk8d6"] Jun 11 12:53:30.972916 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.972648 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jqp4m"] Jun 11 12:53:30.973316 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.973283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:30.973316 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:30.973307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:30.973483 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:30.973397 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:30.973537 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:30.973502 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:31.341370 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:31.341336 2577 generic.go:356] "Generic (PLEG): container finished" podID="55714e61-ac46-4644-9cdc-d27042b7543e" containerID="12f683820f75c1e52e7deda4432d06631b7e9af9815568112d4cc01769706951" exitCode=0 Jun 11 12:53:31.341757 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:31.341418 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerDied","Data":"12f683820f75c1e52e7deda4432d06631b7e9af9815568112d4cc01769706951"} Jun 11 12:53:32.181979 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:32.181764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:32.182148 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:32.182072 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:33.181480 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:33.181390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:33.181480 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:33.181425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:33.181964 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:33.181527 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:33.181964 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:33.181623 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:34.181966 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:34.181925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:34.182654 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:34.182056 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:35.181981 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:35.181891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:35.182414 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:35.181892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:35.182414 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.182038 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gqz86" podUID="c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6" Jun 11 12:53:35.182414 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.182099 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jqp4m" podUID="a1baaaed-88ee-4f1a-8749-d4d292b354c0" Jun 11 12:53:35.976064 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:35.975982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:35.976064 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:35.976023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976126 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976129 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:35.976148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976172 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret podName:c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6 nodeName:}" failed. No retries permitted until 2026-06-11 12:54:07.976158565 +0000 UTC m=+66.283460176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret") pod "global-pull-secret-syncer-gqz86" (UID: "c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976199 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:54:07.976186145 +0000 UTC m=+66.283487756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976246 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976262 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976273 2577 projected.go:196] Error preparing data for projected volume kube-api-access-zrzhf for pod openshift-network-diagnostics/network-check-target-jqp4m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:35.976339 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:35.976325 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf podName:a1baaaed-88ee-4f1a-8749-d4d292b354c0 nodeName:}" failed. No retries permitted until 2026-06-11 12:54:07.976308234 +0000 UTC m=+66.283609860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zrzhf" (UniqueName: "kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf") pod "network-check-target-jqp4m" (UID: "a1baaaed-88ee-4f1a-8749-d4d292b354c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:36.181914 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:36.181877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:36.182139 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:36.181997 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:53:36.363892 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:36.363859 2577 generic.go:356] "Generic (PLEG): container finished" podID="55714e61-ac46-4644-9cdc-d27042b7543e" containerID="3351a1729c9f30c6d8cd32b18cfc5fc33a4d8ffc4dff9738b76e5aa38caece5c" exitCode=0 Jun 11 12:53:36.364081 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:36.363911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerDied","Data":"3351a1729c9f30c6d8cd32b18cfc5fc33a4d8ffc4dff9738b76e5aa38caece5c"} Jun 11 12:53:36.969976 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:36.969938 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-157.ec2.internal" event="NodeReady" Jun 11 12:53:36.970221 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:36.970078 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 12:53:37.018077 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.018045 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7zwkn"] Jun 11 12:53:37.044892 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.044849 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rv994"] Jun 11 12:53:37.045067 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.044995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.048133 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.048110 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 12:53:37.048325 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.048311 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjs9v\"" Jun 11 12:53:37.048477 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.048466 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 12:53:37.062886 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.062855 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rv994"] Jun 11 12:53:37.062993 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.062900 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zwkn"] Jun 11 12:53:37.062993 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.062904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.066420 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.066246 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 12:53:37.066420 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.066367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 12:53:37.066420 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.066377 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s5krz\"" Jun 11 12:53:37.076754 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.076734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 12:53:37.158460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.158427 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:37.181460 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.181429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:53:37.181596 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.181429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:53:37.184385 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.184363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582pc\" (UniqueName: \"kubernetes.io/projected/ae57c229-a286-4bd4-8370-4e3095c480af-kube-api-access-582pc\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.184855 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.184427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae57c229-a286-4bd4-8370-4e3095c480af-tmp-dir\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.184912 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.184888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tv44\"" Jun 11 12:53:37.184961 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.184897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83adae1f-e10f-4192-ab7b-ade962311ad5-cert\") pod \"ingress-canary-rv994\" (UID: \"83adae1f-e10f-4192-ab7b-ade962311ad5\") " pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.184961 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.184949 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:53:37.185049 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.184982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcgq8\" (UniqueName: \"kubernetes.io/projected/83adae1f-e10f-4192-ab7b-ade962311ad5-kube-api-access-pcgq8\") pod \"ingress-canary-rv994\" (UID: \"83adae1f-e10f-4192-ab7b-ade962311ad5\") " pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.185049 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.184988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:53:37.185049 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.185010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.185189 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.185149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae57c229-a286-4bd4-8370-4e3095c480af-config-volume\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.185459 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.185438 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:53:37.219847 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.219814 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:37.286404 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.286315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae57c229-a286-4bd4-8370-4e3095c480af-tmp-dir\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.286404 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.286367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83adae1f-e10f-4192-ab7b-ade962311ad5-cert\") pod \"ingress-canary-rv994\" (UID: \"83adae1f-e10f-4192-ab7b-ade962311ad5\") " pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.286404 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.286390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgq8\" (UniqueName: \"kubernetes.io/projected/83adae1f-e10f-4192-ab7b-ade962311ad5-kube-api-access-pcgq8\") pod \"ingress-canary-rv994\" (UID: \"83adae1f-e10f-4192-ab7b-ade962311ad5\") " pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.286633 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.286410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.286633 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.286431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae57c229-a286-4bd4-8370-4e3095c480af-config-volume\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.286633 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.286455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582pc\" (UniqueName: \"kubernetes.io/projected/ae57c229-a286-4bd4-8370-4e3095c480af-kube-api-access-582pc\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.286633 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:37.286582 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:37.286843 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:37.286681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:53:37.786634982 +0000 UTC m=+36.093936599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:53:37.286843 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.286748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae57c229-a286-4bd4-8370-4e3095c480af-tmp-dir\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.287209 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.287189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae57c229-a286-4bd4-8370-4e3095c480af-config-volume\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.290748 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.290732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83adae1f-e10f-4192-ab7b-ade962311ad5-cert\") pod \"ingress-canary-rv994\" (UID: \"83adae1f-e10f-4192-ab7b-ade962311ad5\") " pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.297063 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.297034 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-582pc\" (UniqueName: \"kubernetes.io/projected/ae57c229-a286-4bd4-8370-4e3095c480af-kube-api-access-582pc\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.297247 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.297227 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgq8\" (UniqueName: \"kubernetes.io/projected/83adae1f-e10f-4192-ab7b-ade962311ad5-kube-api-access-pcgq8\") pod \"ingress-canary-rv994\" (UID: \"83adae1f-e10f-4192-ab7b-ade962311ad5\") " pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.369637 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.369601 2577 generic.go:356] "Generic (PLEG): container finished" podID="55714e61-ac46-4644-9cdc-d27042b7543e" containerID="86ecc9bef855d1413c36cb62f541e5bad90b6ee28fc351799a6ed3547972b408" exitCode=0 Jun 11 12:53:37.369796 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.369680 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerDied","Data":"86ecc9bef855d1413c36cb62f541e5bad90b6ee28fc351799a6ed3547972b408"} Jun 11 12:53:37.371233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.371214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rv994" Jun 11 12:53:37.566573 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.566377 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rv994"] Jun 11 12:53:37.570598 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:53:37.570572 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83adae1f_e10f_4192_ab7b_ade962311ad5.slice/crio-7086f2e2d249a646777dc85ce673e35ef114020aef7cd3b3555658a086d8a6c0 WatchSource:0}: Error finding container 7086f2e2d249a646777dc85ce673e35ef114020aef7cd3b3555658a086d8a6c0: Status 404 returned error can't find the container with id 7086f2e2d249a646777dc85ce673e35ef114020aef7cd3b3555658a086d8a6c0 Jun 11 12:53:37.791848 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:37.791804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:37.792021 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:37.791953 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:37.792062 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:37.792028 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:53:38.792003588 +0000 UTC m=+37.099305198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:53:38.184736 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:38.184706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:53:38.187850 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:38.187820 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:53:38.187986 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:38.187895 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zkphv\"" Jun 11 12:53:38.375233 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:38.375191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" event={"ID":"55714e61-ac46-4644-9cdc-d27042b7543e","Type":"ContainerStarted","Data":"904b457280d199315e3fec7bf9f5fd70af1bdda3972d70efd3edcff70f873ee1"} Jun 11 12:53:38.376273 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:38.376250 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rv994" event={"ID":"83adae1f-e10f-4192-ab7b-ade962311ad5","Type":"ContainerStarted","Data":"7086f2e2d249a646777dc85ce673e35ef114020aef7cd3b3555658a086d8a6c0"} Jun 11 12:53:38.397706 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:38.397640 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wwkw5" podStartSLOduration=7.964514305 podStartE2EDuration="36.397624196s" totalImagesPullingTime="28.433109891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:38.397380841 +0000 UTC m=+36.704682475" watchObservedRunningTime="2026-06-11 12:53:38.397624196 +0000 UTC m=+36.704925829" Jun 11 12:53:38.799705 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:38.799651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:38.799886 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:38.799811 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:38.799886 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:38.799874 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:53:40.799858463 +0000 UTC m=+39.107160074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:53:40.382643 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:40.382609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rv994" event={"ID":"83adae1f-e10f-4192-ab7b-ade962311ad5","Type":"ContainerStarted","Data":"0e7652d6038051e3343e6aaacdccfddd41cd74bae68ac9a7cf3801aef097f0b9"} Jun 11 12:53:40.400209 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:40.400154 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rv994" podStartSLOduration=1.101315904 podStartE2EDuration="3.400139508s" totalImagesPullingTime="2.298823604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:40.398891468 +0000 UTC m=+38.706193101" watchObservedRunningTime="2026-06-11 12:53:40.400139508 +0000 UTC m=+38.707441140" Jun 11 12:53:40.813499 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:40.813458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:40.813696 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:40.813591 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:40.813696 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:40.813653 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:53:44.813639762 +0000 UTC m=+43.120941373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:53:44.840128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:44.840072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:44.840594 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:44.840236 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:44.840594 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:44.840307 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:53:52.840289874 +0000 UTC m=+51.147591490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:53:52.899031 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:53:52.898992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:53:52.899560 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:52.899128 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:52.899560 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:53:52.899195 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:54:08.899179194 +0000 UTC m=+67.206480805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:54:02.355086 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:02.355058 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6ptv" Jun 11 12:54:08.001334 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.001287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:54:08.001334 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.001337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:54:08.001877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.001378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:54:08.004108 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.004084 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:54:08.004211 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.004114 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:54:08.004211 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.004196 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:54:08.012510 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:54:08.012475 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:54:08.012615 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:54:08.012552 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:55:12.012535394 +0000 UTC m=+130.319837006 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : secret "metrics-daemon-secret" not found Jun 11 12:54:08.014762 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.014743 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:54:08.016387 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.016366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6-original-pull-secret\") pod \"global-pull-secret-syncer-gqz86\" (UID: \"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6\") " pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:54:08.025253 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.025230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzhf\" (UniqueName: \"kubernetes.io/projected/a1baaaed-88ee-4f1a-8749-d4d292b354c0-kube-api-access-zrzhf\") pod \"network-check-target-jqp4m\" (UID: \"a1baaaed-88ee-4f1a-8749-d4d292b354c0\") " pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:54:08.095340 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.095308 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tv44\"" Jun 11 12:54:08.097435 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.097414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gqz86" Jun 11 12:54:08.102971 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.102954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:54:08.232411 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.232374 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gqz86"] Jun 11 12:54:08.236261 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:54:08.236237 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f74e9a_504b_4ed2_bbe3_52d31d1c5ac6.slice/crio-180f052e69d6bfb2f9bb0b0d03c6d5bf137d150318b6c7d7317f3e8fb4cec873 WatchSource:0}: Error finding container 180f052e69d6bfb2f9bb0b0d03c6d5bf137d150318b6c7d7317f3e8fb4cec873: Status 404 returned error can't find the container with id 180f052e69d6bfb2f9bb0b0d03c6d5bf137d150318b6c7d7317f3e8fb4cec873 Jun 11 12:54:08.244440 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.244401 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jqp4m"] Jun 11 12:54:08.251198 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:54:08.251163 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1baaaed_88ee_4f1a_8749_d4d292b354c0.slice/crio-31054f04e529703c778532e62f327ef9b2c1467746d97e8766e4501dae2ce134 WatchSource:0}: Error finding container 31054f04e529703c778532e62f327ef9b2c1467746d97e8766e4501dae2ce134: Status 404 returned error can't find the container with id 31054f04e529703c778532e62f327ef9b2c1467746d97e8766e4501dae2ce134 Jun 11 12:54:08.445346 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.445310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jqp4m" event={"ID":"a1baaaed-88ee-4f1a-8749-d4d292b354c0","Type":"ContainerStarted","Data":"31054f04e529703c778532e62f327ef9b2c1467746d97e8766e4501dae2ce134"} Jun 11 12:54:08.446391 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.446359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqz86" event={"ID":"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6","Type":"ContainerStarted","Data":"180f052e69d6bfb2f9bb0b0d03c6d5bf137d150318b6c7d7317f3e8fb4cec873"} Jun 11 12:54:08.907284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:08.907233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:54:08.907557 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:54:08.907393 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:54:08.907557 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:54:08.907469 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:54:40.907448844 +0000 UTC m=+99.214750476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:54:13.460378 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:13.460337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jqp4m" event={"ID":"a1baaaed-88ee-4f1a-8749-d4d292b354c0","Type":"ContainerStarted","Data":"affde41cad8f4e891847028059f04cd00d40cc04ab2a0d3f433e2f0f56c8c0b7"} Jun 11 12:54:13.460842 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:13.460453 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:54:13.461863 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:13.461840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gqz86" event={"ID":"c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6","Type":"ContainerStarted","Data":"e8cd2103ab7b9d3597326b47d4b7cd74f42af7bcbf5bc4d85ce6173e0121c109"} Jun 11 12:54:13.476298 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:13.476249 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jqp4m" podStartSLOduration=67.210007749 podStartE2EDuration="1m11.47623326s" totalImagesPullingTime="4.266225511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:54:13.475331024 +0000 UTC m=+71.782632681" watchObservedRunningTime="2026-06-11 12:54:13.47623326 +0000 UTC m=+71.783534893" Jun 11 12:54:13.489678 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:13.489624 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gqz86" podStartSLOduration=67.204874834 podStartE2EDuration="1m11.489613075s" totalImagesPullingTime="4.284738241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:54:13.489319828 +0000 UTC m=+71.796621461" watchObservedRunningTime="2026-06-11 12:54:13.489613075 +0000 UTC m=+71.796914707" Jun 11 12:54:40.922254 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:40.922205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:54:40.922707 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:54:40.922347 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:54:40.922707 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:54:40.922434 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:55:44.922418355 +0000 UTC m=+163.229719965 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:54:44.466779 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:44.466750 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jqp4m" Jun 11 12:54:57.290255 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.290214 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6"] Jun 11 12:54:57.292423 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.292405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.296804 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.296781 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx"] Jun 11 12:54:57.297135 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.297108 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 12:54:57.297227 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.297182 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 12:54:57.297404 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.297370 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 12:54:57.297924 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.297900 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 12:54:57.299359 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.299340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.301602 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.301580 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 12:54:57.301721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.301609 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 12:54:57.301721 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.301648 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 12:54:57.301829 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.301721 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 12:54:57.304429 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.304400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6"] Jun 11 12:54:57.315193 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.315170 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx"] Jun 11 12:54:57.434026 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.433976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.434026 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.434263 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kttql\" (UniqueName: \"kubernetes.io/projected/0cfd8d0d-4f31-45de-9989-43c95466ea5c-kube-api-access-kttql\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.434263 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53ca4223-b8b1-4baa-9dde-3622bd506791-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.434263 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-ca\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.434263 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6bzs\" (UniqueName: \"kubernetes.io/projected/53ca4223-b8b1-4baa-9dde-3622bd506791-kube-api-access-j6bzs\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.434263 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cfd8d0d-4f31-45de-9989-43c95466ea5c-tmp\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.434438 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-hub\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.434438 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.434308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0cfd8d0d-4f31-45de-9989-43c95466ea5c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.535587 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.535552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cfd8d0d-4f31-45de-9989-43c95466ea5c-tmp\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.535782 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.535599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-hub\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.535782 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.535619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0cfd8d0d-4f31-45de-9989-43c95466ea5c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.535885 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.535867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.535923 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.535901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.535973 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.535924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kttql\" (UniqueName: \"kubernetes.io/projected/0cfd8d0d-4f31-45de-9989-43c95466ea5c-kube-api-access-kttql\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.536022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.535976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53ca4223-b8b1-4baa-9dde-3622bd506791-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.536022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.536004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-ca\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.536116 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.536026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6bzs\" (UniqueName: \"kubernetes.io/projected/53ca4223-b8b1-4baa-9dde-3622bd506791-kube-api-access-j6bzs\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.536172 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.536145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cfd8d0d-4f31-45de-9989-43c95466ea5c-tmp\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.536733 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.536704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/53ca4223-b8b1-4baa-9dde-3622bd506791-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.538408 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.538379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.538732 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.538711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-ca\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.538827 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.538779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-hub\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.538827 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.538812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0cfd8d0d-4f31-45de-9989-43c95466ea5c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.538927 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.538861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53ca4223-b8b1-4baa-9dde-3622bd506791-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.544939 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.544855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kttql\" (UniqueName: \"kubernetes.io/projected/0cfd8d0d-4f31-45de-9989-43c95466ea5c-kube-api-access-kttql\") pod \"klusterlet-addon-workmgr-7d696d6489-l44p6\" (UID: \"0cfd8d0d-4f31-45de-9989-43c95466ea5c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.544939 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.544909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6bzs\" (UniqueName: \"kubernetes.io/projected/53ca4223-b8b1-4baa-9dde-3622bd506791-kube-api-access-j6bzs\") pod \"cluster-proxy-proxy-agent-6c8fd5c654-5bvxx\" (UID: \"53ca4223-b8b1-4baa-9dde-3622bd506791\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.602062 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.602026 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:54:57.621315 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.621277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:54:57.738110 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.738077 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6"] Jun 11 12:54:57.740715 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:54:57.740689 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfd8d0d_4f31_45de_9989_43c95466ea5c.slice/crio-b1a6cb901d9aac56dd6661e0736164a4353b6eb5e88d45f57124f6268b5a8dee WatchSource:0}: Error finding container b1a6cb901d9aac56dd6661e0736164a4353b6eb5e88d45f57124f6268b5a8dee: Status 404 returned error can't find the container with id b1a6cb901d9aac56dd6661e0736164a4353b6eb5e88d45f57124f6268b5a8dee Jun 11 12:54:57.753256 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:57.753233 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx"] Jun 11 12:54:57.756451 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:54:57.756424 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53ca4223_b8b1_4baa_9dde_3622bd506791.slice/crio-9b6a073dddec276170df6387f6c31377f3c96d1e2ab786624ebde1050345ea1e WatchSource:0}: Error finding container 9b6a073dddec276170df6387f6c31377f3c96d1e2ab786624ebde1050345ea1e: Status 404 returned error can't find the container with id 9b6a073dddec276170df6387f6c31377f3c96d1e2ab786624ebde1050345ea1e Jun 11 12:54:58.570640 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:58.570598 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" event={"ID":"0cfd8d0d-4f31-45de-9989-43c95466ea5c","Type":"ContainerStarted","Data":"b1a6cb901d9aac56dd6661e0736164a4353b6eb5e88d45f57124f6268b5a8dee"} Jun 11 12:54:58.572882 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:54:58.572847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" event={"ID":"53ca4223-b8b1-4baa-9dde-3622bd506791","Type":"ContainerStarted","Data":"9b6a073dddec276170df6387f6c31377f3c96d1e2ab786624ebde1050345ea1e"} Jun 11 12:55:03.589894 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.589860 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" event={"ID":"0cfd8d0d-4f31-45de-9989-43c95466ea5c","Type":"ContainerStarted","Data":"70abf74498bdbf6eacfde73a7232321c78b927e06002c586bd9bb75b5b1bf8ec"} Jun 11 12:55:03.590482 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.590028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:55:03.592108 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.592078 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:55:03.592237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.592119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" event={"ID":"53ca4223-b8b1-4baa-9dde-3622bd506791","Type":"ContainerStarted","Data":"06fee2ea13d1e5970cd2f59e28030a411d276debeb8dddd6780f9fc98ecd4e74"} Jun 11 12:55:03.592237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.592142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" event={"ID":"53ca4223-b8b1-4baa-9dde-3622bd506791","Type":"ContainerStarted","Data":"1737142df1e2e9b024cb0196083339e062794a3bd7c944d8ce9c7ca00506e77f"} Jun 11 12:55:03.592237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.592159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" event={"ID":"53ca4223-b8b1-4baa-9dde-3622bd506791","Type":"ContainerStarted","Data":"e6cddc535a5d61152544ec43984809474d60ef5593f0fff0bda937782cf3aa4e"} Jun 11 12:55:03.607251 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.607202 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" podStartSLOduration=1.49428793 podStartE2EDuration="6.607185095s" totalImagesPullingTime="5.112897165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:55:03.606937819 +0000 UTC m=+121.914239453" watchObservedRunningTime="2026-06-11 12:55:03.607185095 +0000 UTC m=+121.914486727" Jun 11 12:55:03.644875 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:03.644824 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" podStartSLOduration=1.550122144 podStartE2EDuration="6.64480834s" totalImagesPullingTime="5.094686196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:55:03.644190226 +0000 UTC m=+121.951491859" watchObservedRunningTime="2026-06-11 12:55:03.64480834 +0000 UTC m=+121.952109977" Jun 11 12:55:12.046863 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:12.046818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:55:12.047355 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:55:12.046964 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:55:12.047355 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:55:12.047032 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs podName:5e71a2cf-a469-4136-bae5-eba4685d3086 nodeName:}" failed. No retries permitted until 2026-06-11 12:57:14.047016089 +0000 UTC m=+252.354317700 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs") pod "network-metrics-daemon-nk8d6" (UID: "5e71a2cf-a469-4136-bae5-eba4685d3086") : secret "metrics-daemon-secret" not found Jun 11 12:55:40.053796 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:55:40.053733 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7zwkn" podUID="ae57c229-a286-4bd4-8370-4e3095c480af" Jun 11 12:55:40.697314 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:40.697242 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zwkn" Jun 11 12:55:41.195142 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:55:41.195095 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nk8d6" podUID="5e71a2cf-a469-4136-bae5-eba4685d3086" Jun 11 12:55:44.983232 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:44.983189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:55:44.983654 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:55:44.983314 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:55:44.983654 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:55:44.983373 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls podName:ae57c229-a286-4bd4-8370-4e3095c480af nodeName:}" failed. No retries permitted until 2026-06-11 12:57:46.983359466 +0000 UTC m=+285.290661078 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls") pod "dns-default-7zwkn" (UID: "ae57c229-a286-4bd4-8370-4e3095c480af") : secret "dns-default-metrics-tls" not found Jun 11 12:55:56.181163 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:55:56.181066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:56:45.157198 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:56:45.157170 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h79dg_1155a92d-ee4a-4f76-a8b3-73b4392e8f86/dns-node-resolver/0.log" Jun 11 12:56:46.157936 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:56:46.157909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tz5pm_54faeadc-5eee-405d-a2b4-e1fb58b9bcd0/node-ca/0.log" Jun 11 12:56:46.958477 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:56:46.958451 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rv994_83adae1f-e10f-4192-ab7b-ade962311ad5/serve-healthcheck-canary/0.log" Jun 11 12:57:03.591282 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:03.591224 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" podUID="0cfd8d0d-4f31-45de-9989-43c95466ea5c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 11 12:57:03.930564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:03.930483 2577 generic.go:356] "Generic (PLEG): container finished" podID="0cfd8d0d-4f31-45de-9989-43c95466ea5c" containerID="70abf74498bdbf6eacfde73a7232321c78b927e06002c586bd9bb75b5b1bf8ec" exitCode=1 Jun 11 12:57:03.930564 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:03.930523 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" event={"ID":"0cfd8d0d-4f31-45de-9989-43c95466ea5c","Type":"ContainerDied","Data":"70abf74498bdbf6eacfde73a7232321c78b927e06002c586bd9bb75b5b1bf8ec"} Jun 11 12:57:03.930879 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:03.930867 2577 scope.go:117] "RemoveContainer" containerID="70abf74498bdbf6eacfde73a7232321c78b927e06002c586bd9bb75b5b1bf8ec" Jun 11 12:57:04.935286 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:04.935247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" event={"ID":"0cfd8d0d-4f31-45de-9989-43c95466ea5c","Type":"ContainerStarted","Data":"ae4b0a42ea9ffc9a8bd054091ec36e79f80ccd28d0ade5fda2845e9a4cb5cecf"} Jun 11 12:57:04.935689 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:04.935529 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:57:04.936116 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:04.936102 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d696d6489-l44p6" Jun 11 12:57:08.983926 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.983899 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gmbw4"] Jun 11 12:57:08.986748 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.986732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:08.990505 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.990487 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cw2rk\"" Jun 11 12:57:08.991537 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.991518 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 12:57:08.991729 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.991547 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 12:57:08.991876 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.991860 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 12:57:08.991926 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.991863 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 12:57:08.999358 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:08.999219 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gmbw4"] Jun 11 12:57:09.085238 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.085202 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55b57c7877-trxmn"] Jun 11 12:57:09.088137 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.088121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.090759 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b394226-0fbe-4a0f-9598-80fd3336f11e-data-volume\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.090877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b394226-0fbe-4a0f-9598-80fd3336f11e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.090877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv8z7\" (UniqueName: \"kubernetes.io/projected/1b394226-0fbe-4a0f-9598-80fd3336f11e-kube-api-access-vv8z7\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.090877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090793 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 12:57:09.090877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b394226-0fbe-4a0f-9598-80fd3336f11e-crio-socket\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.090877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b394226-0fbe-4a0f-9598-80fd3336f11e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.091086 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090932 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 12:57:09.091086 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090931 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lsrj5\"" Jun 11 12:57:09.091086 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.090953 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 12:57:09.095024 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.095005 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 12:57:09.102845 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.102821 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55b57c7877-trxmn"] Jun 11 12:57:09.191959 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.191919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d04d8c-e982-46ab-bbfd-c023d8d817e1-installation-pull-secrets\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.191959 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.191965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-registry-tls\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.191959 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.191984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d04d8c-e982-46ab-bbfd-c023d8d817e1-trusted-ca\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b394226-0fbe-4a0f-9598-80fd3336f11e-data-volume\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b394226-0fbe-4a0f-9598-80fd3336f11e-crio-socket\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv8z7\" (UniqueName: \"kubernetes.io/projected/1b394226-0fbe-4a0f-9598-80fd3336f11e-kube-api-access-vv8z7\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b394226-0fbe-4a0f-9598-80fd3336f11e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d04d8c-e982-46ab-bbfd-c023d8d817e1-registry-certificates\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192131 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b394226-0fbe-4a0f-9598-80fd3336f11e-crio-socket\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-bound-sa-token\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mntd6\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-kube-api-access-mntd6\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.192237 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d04d8c-e982-46ab-bbfd-c023d8d817e1-ca-trust-extracted\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.192528 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b394226-0fbe-4a0f-9598-80fd3336f11e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.192528 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d04d8c-e982-46ab-bbfd-c023d8d817e1-image-registry-private-configuration\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.192528 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b394226-0fbe-4a0f-9598-80fd3336f11e-data-volume\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.192724 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.192708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b394226-0fbe-4a0f-9598-80fd3336f11e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.194421 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.194403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b394226-0fbe-4a0f-9598-80fd3336f11e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.202284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.202257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv8z7\" (UniqueName: \"kubernetes.io/projected/1b394226-0fbe-4a0f-9598-80fd3336f11e-kube-api-access-vv8z7\") pod \"insights-runtime-extractor-gmbw4\" (UID: \"1b394226-0fbe-4a0f-9598-80fd3336f11e\") " pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.293587 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d04d8c-e982-46ab-bbfd-c023d8d817e1-registry-certificates\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.293587 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-bound-sa-token\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.293587 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mntd6\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-kube-api-access-mntd6\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.293945 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d04d8c-e982-46ab-bbfd-c023d8d817e1-ca-trust-extracted\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.293945 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d04d8c-e982-46ab-bbfd-c023d8d817e1-image-registry-private-configuration\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.293945 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d04d8c-e982-46ab-bbfd-c023d8d817e1-installation-pull-secrets\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.293945 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-registry-tls\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.293945 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.293731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d04d8c-e982-46ab-bbfd-c023d8d817e1-trusted-ca\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.294372 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.294348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d04d8c-e982-46ab-bbfd-c023d8d817e1-ca-trust-extracted\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.294480 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.294455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d04d8c-e982-46ab-bbfd-c023d8d817e1-registry-certificates\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.294846 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.294823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d04d8c-e982-46ab-bbfd-c023d8d817e1-trusted-ca\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.294984 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.294966 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gmbw4" Jun 11 12:57:09.296258 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.296239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d04d8c-e982-46ab-bbfd-c023d8d817e1-installation-pull-secrets\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.296353 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.296275 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-registry-tls\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.296353 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.296303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d04d8c-e982-46ab-bbfd-c023d8d817e1-image-registry-private-configuration\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.304983 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.304948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mntd6\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-kube-api-access-mntd6\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.305112 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.304972 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d04d8c-e982-46ab-bbfd-c023d8d817e1-bound-sa-token\") pod \"image-registry-55b57c7877-trxmn\" (UID: \"23d04d8c-e982-46ab-bbfd-c023d8d817e1\") " pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.398001 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.397960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.429400 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.429369 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gmbw4"] Jun 11 12:57:09.432546 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:57:09.432515 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b394226_0fbe_4a0f_9598_80fd3336f11e.slice/crio-9634d72b3b8a423eb56db7f1b4b7f3f00c4a2f64c18afa48b88f72a7eb8c542b WatchSource:0}: Error finding container 9634d72b3b8a423eb56db7f1b4b7f3f00c4a2f64c18afa48b88f72a7eb8c542b: Status 404 returned error can't find the container with id 9634d72b3b8a423eb56db7f1b4b7f3f00c4a2f64c18afa48b88f72a7eb8c542b Jun 11 12:57:09.525238 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.525095 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55b57c7877-trxmn"] Jun 11 12:57:09.527485 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:57:09.527464 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d04d8c_e982_46ab_bbfd_c023d8d817e1.slice/crio-f389c57fd8c946082070eb77442dd4db9ea0cc16eb0a8d91d5d09262448dfa83 WatchSource:0}: Error finding container f389c57fd8c946082070eb77442dd4db9ea0cc16eb0a8d91d5d09262448dfa83: Status 404 returned error can't find the container with id f389c57fd8c946082070eb77442dd4db9ea0cc16eb0a8d91d5d09262448dfa83 Jun 11 12:57:09.953546 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.953499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" event={"ID":"23d04d8c-e982-46ab-bbfd-c023d8d817e1","Type":"ContainerStarted","Data":"3e86f34a80d18d56d24b720eb1fa95fccfaff75041254dd635c36de50b26019e"} Jun 11 12:57:09.953748 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.953562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" event={"ID":"23d04d8c-e982-46ab-bbfd-c023d8d817e1","Type":"ContainerStarted","Data":"f389c57fd8c946082070eb77442dd4db9ea0cc16eb0a8d91d5d09262448dfa83"} Jun 11 12:57:09.953748 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.953635 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:09.955343 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.955317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmbw4" event={"ID":"1b394226-0fbe-4a0f-9598-80fd3336f11e","Type":"ContainerStarted","Data":"d4c651acc23ba7feb68af2b03062be3a42258a2c9a9de4e42d27d6ecb43f3731"} Jun 11 12:57:09.955465 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.955377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmbw4" event={"ID":"1b394226-0fbe-4a0f-9598-80fd3336f11e","Type":"ContainerStarted","Data":"9634d72b3b8a423eb56db7f1b4b7f3f00c4a2f64c18afa48b88f72a7eb8c542b"} Jun 11 12:57:09.973566 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:09.973506 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podStartSLOduration=0.973482203 podStartE2EDuration="973.482203ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:09.972302368 +0000 UTC m=+248.279604015" watchObservedRunningTime="2026-06-11 12:57:09.973482203 +0000 UTC m=+248.280783836" Jun 11 12:57:10.960569 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:10.960529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmbw4" event={"ID":"1b394226-0fbe-4a0f-9598-80fd3336f11e","Type":"ContainerStarted","Data":"321d2d4a9f910dd1f381d5ca6d7721959c6d0f3bf2f2d0340c9b124a6d775766"} Jun 11 12:57:11.965024 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:11.964987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmbw4" event={"ID":"1b394226-0fbe-4a0f-9598-80fd3336f11e","Type":"ContainerStarted","Data":"38579621943f9d4e5b9cc214d88536c02f4286f5fbad19ad6a929b62e4d05fdb"} Jun 11 12:57:11.984171 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:11.984079 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gmbw4" podStartSLOduration=1.797949692 podStartE2EDuration="3.984062543s" totalImagesPullingTime="2.186112851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:57:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:11.982401159 +0000 UTC m=+250.289702803" watchObservedRunningTime="2026-06-11 12:57:11.984062543 +0000 UTC m=+250.291364175" Jun 11 12:57:14.128174 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:14.128138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:57:14.130399 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:14.130378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e71a2cf-a469-4136-bae5-eba4685d3086-metrics-certs\") pod \"network-metrics-daemon-nk8d6\" (UID: \"5e71a2cf-a469-4136-bae5-eba4685d3086\") " pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:57:14.184554 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:14.184527 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zkphv\"" Jun 11 12:57:14.193085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:14.193060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk8d6" Jun 11 12:57:14.312334 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:14.312303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nk8d6"] Jun 11 12:57:14.315002 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:57:14.314958 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e71a2cf_a469_4136_bae5_eba4685d3086.slice/crio-7d9644ac8a30dd4ca864c30b0e2f004daf787ae9e8bb71eec6a90d155b777b47 WatchSource:0}: Error finding container 7d9644ac8a30dd4ca864c30b0e2f004daf787ae9e8bb71eec6a90d155b777b47: Status 404 returned error can't find the container with id 7d9644ac8a30dd4ca864c30b0e2f004daf787ae9e8bb71eec6a90d155b777b47 Jun 11 12:57:14.976478 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:14.976442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nk8d6" event={"ID":"5e71a2cf-a469-4136-bae5-eba4685d3086","Type":"ContainerStarted","Data":"7d9644ac8a30dd4ca864c30b0e2f004daf787ae9e8bb71eec6a90d155b777b47"} Jun 11 12:57:15.981578 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:15.981540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nk8d6" event={"ID":"5e71a2cf-a469-4136-bae5-eba4685d3086","Type":"ContainerStarted","Data":"470eba316f6b516953619869550bcc0399271d3d82ab45f812d4e01c9ba2d12d"} Jun 11 12:57:15.982088 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:15.981600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nk8d6" event={"ID":"5e71a2cf-a469-4136-bae5-eba4685d3086","Type":"ContainerStarted","Data":"cca4302859f9649de2d6bd747ab47d9cb8f60be496ad1f4c94f17deaf5d5b179"} Jun 11 12:57:16.000470 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:16.000400 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nk8d6" podStartSLOduration=253.197884675 podStartE2EDuration="4m14.000382335s" totalImagesPullingTime="802.49766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:15.998594569 +0000 UTC m=+254.305896215" watchObservedRunningTime="2026-06-11 12:57:16.000382335 +0000 UTC m=+254.307683968" Jun 11 12:57:21.239309 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.239234 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v5zv9"] Jun 11 12:57:21.242365 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.242343 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.245054 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.245028 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 12:57:21.245160 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.245081 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 12:57:21.245160 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.245081 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 12:57:21.245255 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.245031 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tjj7q\"" Jun 11 12:57:21.246051 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.246032 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 12:57:21.246216 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.246067 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 12:57:21.246216 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.246105 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 12:57:21.279324 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-textfile\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279492 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-tls\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279492 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b45016-0d7e-4935-8cbc-abc2b16c76e5-metrics-client-ca\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279492 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279492 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-root\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279492 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-sys\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279492 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-wtmp\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279713 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9l8r\" (UniqueName: \"kubernetes.io/projected/42b45016-0d7e-4935-8cbc-abc2b16c76e5-kube-api-access-q9l8r\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.279713 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.279526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380500 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-wtmp\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380500 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9l8r\" (UniqueName: \"kubernetes.io/projected/42b45016-0d7e-4935-8cbc-abc2b16c76e5-kube-api-access-q9l8r\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380742 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380742 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-textfile\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380742 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-tls\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380742 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-wtmp\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380893 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b45016-0d7e-4935-8cbc-abc2b16c76e5-metrics-client-ca\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380893 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.380893 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-root\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.381026 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-root\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.381026 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-sys\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.381026 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.380989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b45016-0d7e-4935-8cbc-abc2b16c76e5-sys\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.381147 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.381121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-textfile\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.381434 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.381413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b45016-0d7e-4935-8cbc-abc2b16c76e5-metrics-client-ca\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.381434 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.381428 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.382987 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.382965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.383108 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.383056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42b45016-0d7e-4935-8cbc-abc2b16c76e5-node-exporter-tls\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.390149 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.390126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9l8r\" (UniqueName: \"kubernetes.io/projected/42b45016-0d7e-4935-8cbc-abc2b16c76e5-kube-api-access-q9l8r\") pod \"node-exporter-v5zv9\" (UID: \"42b45016-0d7e-4935-8cbc-abc2b16c76e5\") " pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.550850 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:21.550780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v5zv9" Jun 11 12:57:21.563724 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:57:21.563696 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b45016_0d7e_4935_8cbc_abc2b16c76e5.slice/crio-3fe93ecf4ebb3b04eb094d147431a091e3adcf204ccdf397bd63700eeadb24cc WatchSource:0}: Error finding container 3fe93ecf4ebb3b04eb094d147431a091e3adcf204ccdf397bd63700eeadb24cc: Status 404 returned error can't find the container with id 3fe93ecf4ebb3b04eb094d147431a091e3adcf204ccdf397bd63700eeadb24cc Jun 11 12:57:22.002043 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:22.002005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zv9" event={"ID":"42b45016-0d7e-4935-8cbc-abc2b16c76e5","Type":"ContainerStarted","Data":"3fe93ecf4ebb3b04eb094d147431a091e3adcf204ccdf397bd63700eeadb24cc"} Jun 11 12:57:23.006440 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:23.006410 2577 generic.go:356] "Generic (PLEG): container finished" podID="42b45016-0d7e-4935-8cbc-abc2b16c76e5" containerID="b68f9e2a221091f0d805b032a8e2422fed53ffbe49d643361956d734631bc718" exitCode=0 Jun 11 12:57:23.006842 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:23.006474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zv9" event={"ID":"42b45016-0d7e-4935-8cbc-abc2b16c76e5","Type":"ContainerDied","Data":"b68f9e2a221091f0d805b032a8e2422fed53ffbe49d643361956d734631bc718"} Jun 11 12:57:24.012093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:24.012059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zv9" event={"ID":"42b45016-0d7e-4935-8cbc-abc2b16c76e5","Type":"ContainerStarted","Data":"6d053ac7e72303c148a113938afc2133eefd6aa2d2745c0e597ea643901a98e4"} Jun 11 12:57:24.012474 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:24.012112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v5zv9" event={"ID":"42b45016-0d7e-4935-8cbc-abc2b16c76e5","Type":"ContainerStarted","Data":"20c183478e539bc55d5609e31f560f9d05cdaaa754641ca3a8161d08820fa0cf"} Jun 11 12:57:24.035707 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:24.035624 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v5zv9" podStartSLOduration=2.172631731 podStartE2EDuration="3.035607811s" totalImagesPullingTime="797.411499ms" totalInitContainerRuntime="65.564581ms" isStatefulPod=true podCreationTimestamp="2026-06-11 12:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:24.033526868 +0000 UTC m=+262.340828512" watchObservedRunningTime="2026-06-11 12:57:24.035607811 +0000 UTC m=+262.342909445" Jun 11 12:57:27.480437 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.480407 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:57:27.483733 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.483714 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.486550 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 12:57:27.486550 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486523 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 12:57:27.486749 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486691 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 12:57:27.486806 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 12:57:27.486876 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486859 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 12:57:27.486934 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486878 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 12:57:27.486934 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486907 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 12:57:27.486934 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.486916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 12:57:27.487032 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.487012 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 12:57:27.487754 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.487738 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95s6qga7rqidd\"" Jun 11 12:57:27.487846 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.487829 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 12:57:27.487899 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.487851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 12:57:27.488066 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.487968 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zjxt2\"" Jun 11 12:57:27.488066 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.487971 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 12:57:27.488341 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.488327 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 12:57:27.490904 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.490884 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 12:57:27.498423 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.498399 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 12:57:27.506151 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.506129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:57:27.525022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.524983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525225 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525225 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-config\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525225 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525225 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525225 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525396 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525396 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525396 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525396 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jmm\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-kube-api-access-d2jmm\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525396 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525563 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525563 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525563 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525563 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525563 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525563 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525797 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.525797 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.525593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.626624 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.626624 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.626837 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.626837 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.626837 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.626837 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.626837 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.626976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627085 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627274 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-config\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627274 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627274 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627274 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627274 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627274 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627567 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627567 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jmm\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-kube-api-access-d2jmm\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627567 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.627567 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.627537 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.628563 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.628535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.629849 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.628834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.629849 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.629505 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.630048 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.630023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.630261 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.630238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-config-out\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631104 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.630656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631205 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.630706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631205 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.630857 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631205 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.631027 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631205 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.631180 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631447 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.631420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631550 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.631509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.631995 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.631972 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-web-config\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.632466 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.632443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.632688 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.632654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.633098 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.633078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.633186 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.633111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.633501 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.633479 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-config\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.636939 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.636922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jmm\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-kube-api-access-d2jmm\") pod \"prometheus-k8s-0\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.792992 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.792908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:27.928265 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:27.928233 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:57:27.931149 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:57:27.931121 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b174164_0650_481d_8f15_6e4da70d7cd5.slice/crio-fc241b34c982ac62a819734d89a1dc2202edc9228ef41bb7c8a29e04df69c55c WatchSource:0}: Error finding container fc241b34c982ac62a819734d89a1dc2202edc9228ef41bb7c8a29e04df69c55c: Status 404 returned error can't find the container with id fc241b34c982ac62a819734d89a1dc2202edc9228ef41bb7c8a29e04df69c55c Jun 11 12:57:28.025877 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:28.025839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerStarted","Data":"fc241b34c982ac62a819734d89a1dc2202edc9228ef41bb7c8a29e04df69c55c"} Jun 11 12:57:29.030387 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:29.030350 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" exitCode=0 Jun 11 12:57:29.030821 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:29.030397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626"} Jun 11 12:57:29.403059 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:29.403009 2577 patch_prober.go:28] interesting pod/image-registry-55b57c7877-trxmn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:29.403203 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:29.403067 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podUID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:30.966764 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:30.966729 2577 patch_prober.go:28] interesting pod/image-registry-55b57c7877-trxmn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:30.967252 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:30.966787 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podUID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:32.044398 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:32.044356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerStarted","Data":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} Jun 11 12:57:32.044882 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:32.044475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerStarted","Data":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} Jun 11 12:57:34.059724 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:34.059696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerStarted","Data":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} Jun 11 12:57:34.060104 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:34.059787 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerStarted","Data":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} Jun 11 12:57:34.060104 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:34.059814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerStarted","Data":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} Jun 11 12:57:35.066189 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:35.066159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerStarted","Data":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} Jun 11 12:57:35.099967 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:35.099892 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4180803539999998 podStartE2EDuration="8.09986654s" totalImagesPullingTime="5.663634198s" totalInitContainerRuntime="18.151988ms" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:35.097343605 +0000 UTC m=+273.404645238" watchObservedRunningTime="2026-06-11 12:57:35.09986654 +0000 UTC m=+273.407168178" Jun 11 12:57:37.623022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:37.622984 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" podUID="53ca4223-b8b1-4baa-9dde-3622bd506791" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 12:57:37.793525 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:37.793494 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:57:39.402093 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:39.402053 2577 patch_prober.go:28] interesting pod/image-registry-55b57c7877-trxmn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:39.402456 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:39.402110 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podUID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:40.965170 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:40.965137 2577 patch_prober.go:28] interesting pod/image-registry-55b57c7877-trxmn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:40.965525 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:40.965189 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podUID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:43.698706 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:57:43.698637 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7zwkn" podUID="ae57c229-a286-4bd4-8370-4e3095c480af" Jun 11 12:57:44.100419 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:44.100392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zwkn" Jun 11 12:57:46.995291 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:46.995248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:57:46.997608 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:46.997585 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae57c229-a286-4bd4-8370-4e3095c480af-metrics-tls\") pod \"dns-default-7zwkn\" (UID: \"ae57c229-a286-4bd4-8370-4e3095c480af\") " pod="openshift-dns/dns-default-7zwkn" Jun 11 12:57:47.106780 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:47.106746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjs9v\"" Jun 11 12:57:47.111859 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:47.111836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zwkn" Jun 11 12:57:47.273268 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:47.271342 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zwkn"] Jun 11 12:57:47.278524 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:57:47.278489 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae57c229_a286_4bd4_8370_4e3095c480af.slice/crio-5786b7bfcb6cc837c9c2bab8ec7832eca9db1205aae2cecf0f2173599dadb707 WatchSource:0}: Error finding container 5786b7bfcb6cc837c9c2bab8ec7832eca9db1205aae2cecf0f2173599dadb707: Status 404 returned error can't find the container with id 5786b7bfcb6cc837c9c2bab8ec7832eca9db1205aae2cecf0f2173599dadb707 Jun 11 12:57:47.623282 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:47.623243 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" podUID="53ca4223-b8b1-4baa-9dde-3622bd506791" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 12:57:48.113962 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:48.113925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zwkn" event={"ID":"ae57c229-a286-4bd4-8370-4e3095c480af","Type":"ContainerStarted","Data":"5786b7bfcb6cc837c9c2bab8ec7832eca9db1205aae2cecf0f2173599dadb707"} Jun 11 12:57:49.119068 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.119030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zwkn" event={"ID":"ae57c229-a286-4bd4-8370-4e3095c480af","Type":"ContainerStarted","Data":"8a288892314ec55a0509298e94aacb7540d63071c8c19864e42c38da72b674a5"} Jun 11 12:57:49.119553 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.119089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zwkn" event={"ID":"ae57c229-a286-4bd4-8370-4e3095c480af","Type":"ContainerStarted","Data":"c3e7ccd9527cb20aa717bdd50836e39926ad139846a935510a428613ed12cb2e"} Jun 11 12:57:49.119553 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.119115 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7zwkn" Jun 11 12:57:49.138453 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.138401 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7zwkn" podStartSLOduration=250.648634288 podStartE2EDuration="4m12.138384977s" totalImagesPullingTime="1.489750689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:49.13754394 +0000 UTC m=+287.444845584" watchObservedRunningTime="2026-06-11 12:57:49.138384977 +0000 UTC m=+287.445686610" Jun 11 12:57:49.402731 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.402614 2577 patch_prober.go:28] interesting pod/image-registry-55b57c7877-trxmn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:49.402731 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.402691 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podUID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:49.402958 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.402740 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:57:49.403296 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.403247 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"3e86f34a80d18d56d24b720eb1fa95fccfaff75041254dd635c36de50b26019e"} pod="openshift-image-registry/image-registry-55b57c7877-trxmn" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 12:57:49.407264 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.407238 2577 patch_prober.go:28] interesting pod/image-registry-55b57c7877-trxmn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:49.407374 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:49.407280 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podUID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:57.622389 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:57.622350 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" podUID="53ca4223-b8b1-4baa-9dde-3622bd506791" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 12:57:57.622823 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:57.622420 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" Jun 11 12:57:57.622934 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:57.622918 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"06fee2ea13d1e5970cd2f59e28030a411d276debeb8dddd6780f9fc98ecd4e74"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 12:57:57.622971 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:57.622953 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" podUID="53ca4223-b8b1-4baa-9dde-3622bd506791" containerName="service-proxy" containerID="cri-o://06fee2ea13d1e5970cd2f59e28030a411d276debeb8dddd6780f9fc98ecd4e74" gracePeriod=30 Jun 11 12:57:58.151893 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:58.151861 2577 generic.go:356] "Generic (PLEG): container finished" podID="53ca4223-b8b1-4baa-9dde-3622bd506791" containerID="06fee2ea13d1e5970cd2f59e28030a411d276debeb8dddd6780f9fc98ecd4e74" exitCode=2 Jun 11 12:57:58.152050 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:58.151923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" event={"ID":"53ca4223-b8b1-4baa-9dde-3622bd506791","Type":"ContainerDied","Data":"06fee2ea13d1e5970cd2f59e28030a411d276debeb8dddd6780f9fc98ecd4e74"} Jun 11 12:57:58.152050 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:58.151955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c8fd5c654-5bvxx" event={"ID":"53ca4223-b8b1-4baa-9dde-3622bd506791","Type":"ContainerStarted","Data":"c22ba51cb10f44df0bc37f63196cacdbc8d29426953cd2d4d1a16fe5722b5650"} Jun 11 12:57:59.124988 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:59.124962 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7zwkn" Jun 11 12:57:59.407115 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:57:59.407047 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:58:02.129572 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:02.129543 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 12:58:02.132344 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:02.132319 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 12:58:02.132477 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:02.132383 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 12:58:09.181035 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:09.181008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rv994_83adae1f-e10f-4192-ab7b-ade962311ad5/serve-healthcheck-canary/0.log" Jun 11 12:58:14.422171 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:14.422129 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" podUID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerName="registry" containerID="cri-o://3e86f34a80d18d56d24b720eb1fa95fccfaff75041254dd635c36de50b26019e" gracePeriod=30 Jun 11 12:58:16.215503 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:16.215473 2577 generic.go:356] "Generic (PLEG): container finished" podID="23d04d8c-e982-46ab-bbfd-c023d8d817e1" containerID="3e86f34a80d18d56d24b720eb1fa95fccfaff75041254dd635c36de50b26019e" exitCode=0 Jun 11 12:58:16.216012 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:16.215520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" event={"ID":"23d04d8c-e982-46ab-bbfd-c023d8d817e1","Type":"ContainerDied","Data":"3e86f34a80d18d56d24b720eb1fa95fccfaff75041254dd635c36de50b26019e"} Jun 11 12:58:16.216012 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:16.215554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" event={"ID":"23d04d8c-e982-46ab-bbfd-c023d8d817e1","Type":"ContainerStarted","Data":"af9c45ff137676430fcd7c621c4e1295dc9bb9d2af253439d549ad55674b4d86"} Jun 11 12:58:16.216012 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:16.215625 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:58:27.793432 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:27.793392 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:27.813438 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:27.813412 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:28.276064 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:28.276039 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:37.222749 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:37.222722 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55b57c7877-trxmn" Jun 11 12:58:45.869648 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:45.869607 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:58:45.870072 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:45.869933 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="prometheus" containerID="cri-o://6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" gracePeriod=600 Jun 11 12:58:45.870072 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:45.869959 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy" containerID="cri-o://93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" gracePeriod=600 Jun 11 12:58:45.870072 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:45.869992 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="thanos-sidecar" containerID="cri-o://18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" gracePeriod=600 Jun 11 12:58:45.870072 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:45.870003 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="config-reloader" containerID="cri-o://cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" gracePeriod=600 Jun 11 12:58:45.870277 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:45.870067 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" gracePeriod=600 Jun 11 12:58:45.870277 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:45.870012 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-web" containerID="cri-o://00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" gracePeriod=600 Jun 11 12:58:46.122887 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.122827 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.237804 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.237769 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.237973 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.237812 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-metrics-client-ca\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.237973 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.237832 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-tls-assets\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.237973 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.237854 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-trusted-ca-bundle\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238168 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238018 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-serving-certs-ca-bundle\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238168 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238079 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-metrics-client-certs\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238168 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238117 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-kube-rbac-proxy\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238168 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238142 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-0\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238172 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-thanos-prometheus-http-client-file\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-tls\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238233 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-config-out\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238267 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-db\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238303 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-1\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238321 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:58:46.238368 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238328 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-kubelet-serving-ca-bundle\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238391 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238409 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238432 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-web-config\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238576 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-grpc-tls\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238592 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238603 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2jmm\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-kube-api-access-d2jmm\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238632 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238659 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-2\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.238783 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.238715 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-config\") pod \"8b174164-0650-481d-8f15-6e4da70d7cd5\" (UID: \"8b174164-0650-481d-8f15-6e4da70d7cd5\") " Jun 11 12:58:46.239196 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.239087 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-metrics-client-ca\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.239196 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.239106 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.239196 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.239121 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.239196 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.239137 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.241113 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.240162 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:58:46.241113 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.240680 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:58:46.241113 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.240827 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:58:46.241113 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.240962 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:58:46.241384 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.241128 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-config-out" (OuterVolumeSpecName: "config-out") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:58:46.241384 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.241169 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-kube-api-access-d2jmm" (OuterVolumeSpecName: "kube-api-access-d2jmm") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "kube-api-access-d2jmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:58:46.241592 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.241561 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-config" (OuterVolumeSpecName: "config") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.242135 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.242071 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.242135 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.242084 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.242288 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.242187 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.242345 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.242316 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:58:46.242507 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.242470 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.243200 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.243182 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.243294 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.243209 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.243518 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.243494 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.252156 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.252130 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-web-config" (OuterVolumeSpecName: "web-config") pod "8b174164-0650-481d-8f15-6e4da70d7cd5" (UID: "8b174164-0650-481d-8f15-6e4da70d7cd5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:58:46.324905 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324874 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" exitCode=0 Jun 11 12:58:46.324905 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324899 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" exitCode=0 Jun 11 12:58:46.324905 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324906 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" exitCode=0 Jun 11 12:58:46.324905 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324912 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" exitCode=0 Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324918 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" exitCode=0 Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324924 2577 generic.go:356] "Generic (PLEG): container finished" podID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" exitCode=0 Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324945 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.324949 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.325005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.325036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.325065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.325093 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.325099 2577 scope.go:117] "RemoveContainer" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.325122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} Jun 11 12:58:46.325214 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.325150 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8b174164-0650-481d-8f15-6e4da70d7cd5","Type":"ContainerDied","Data":"fc241b34c982ac62a819734d89a1dc2202edc9228ef41bb7c8a29e04df69c55c"} Jun 11 12:58:46.334178 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.334156 2577 scope.go:117] "RemoveContainer" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340397 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-grpc-tls\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340424 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2jmm\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-kube-api-access-d2jmm\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340439 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340452 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-config\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340465 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340478 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b174164-0650-481d-8f15-6e4da70d7cd5-tls-assets\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340490 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-metrics-client-certs\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340502 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-kube-rbac-proxy\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340515 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340528 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340541 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340554 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-config-out\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340566 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-db\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340579 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8b174164-0650-481d-8f15-6e4da70d7cd5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340593 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.341000 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.340606 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b174164-0650-481d-8f15-6e4da70d7cd5-web-config\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 12:58:46.342325 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.342300 2577 scope.go:117] "RemoveContainer" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.349045 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.349029 2577 scope.go:117] "RemoveContainer" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.351795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.351773 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:58:46.355874 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.355854 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:58:46.356007 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.355999 2577 scope.go:117] "RemoveContainer" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.362346 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.362329 2577 scope.go:117] "RemoveContainer" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.368875 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.368855 2577 scope.go:117] "RemoveContainer" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.374958 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.374942 2577 scope.go:117] "RemoveContainer" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.375223 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:58:46.375206 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": container with ID starting with 446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b not found: ID does not exist" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.375264 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375232 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} err="failed to get container status \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": rpc error: code = NotFound desc = could not find container \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": container with ID starting with 446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b not found: ID does not exist" Jun 11 12:58:46.375264 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375251 2577 scope.go:117] "RemoveContainer" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.375471 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:58:46.375457 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": container with ID starting with 93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e not found: ID does not exist" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.375506 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375475 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} err="failed to get container status \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": rpc error: code = NotFound desc = could not find container \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": container with ID starting with 93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e not found: ID does not exist" Jun 11 12:58:46.375506 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375497 2577 scope.go:117] "RemoveContainer" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.375743 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:58:46.375717 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": container with ID starting with 00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07 not found: ID does not exist" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.375839 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375747 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} err="failed to get container status \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": rpc error: code = NotFound desc = could not find container \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": container with ID starting with 00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07 not found: ID does not exist" Jun 11 12:58:46.375839 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375764 2577 scope.go:117] "RemoveContainer" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.375985 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:58:46.375970 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": container with ID starting with 18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514 not found: ID does not exist" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.376022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375988 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} err="failed to get container status \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": rpc error: code = NotFound desc = could not find container \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": container with ID starting with 18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514 not found: ID does not exist" Jun 11 12:58:46.376022 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.375999 2577 scope.go:117] "RemoveContainer" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.376192 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:58:46.376178 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": container with ID starting with cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6 not found: ID does not exist" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.376231 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376198 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} err="failed to get container status \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": rpc error: code = NotFound desc = could not find container \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": container with ID starting with cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6 not found: ID does not exist" Jun 11 12:58:46.376231 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376210 2577 scope.go:117] "RemoveContainer" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.376429 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:58:46.376412 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": container with ID starting with 6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12 not found: ID does not exist" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.376477 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376434 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} err="failed to get container status \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": rpc error: code = NotFound desc = could not find container \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": container with ID starting with 6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12 not found: ID does not exist" Jun 11 12:58:46.376477 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376449 2577 scope.go:117] "RemoveContainer" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.376634 ip-10-0-135-157 kubenswrapper[2577]: E0611 12:58:46.376617 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": container with ID starting with d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626 not found: ID does not exist" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.376699 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376638 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626"} err="failed to get container status \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": rpc error: code = NotFound desc = could not find container \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": container with ID starting with d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626 not found: ID does not exist" Jun 11 12:58:46.376699 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376650 2577 scope.go:117] "RemoveContainer" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.376848 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376831 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} err="failed to get container status \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": rpc error: code = NotFound desc = could not find container \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": container with ID starting with 446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b not found: ID does not exist" Jun 11 12:58:46.376904 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.376848 2577 scope.go:117] "RemoveContainer" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.377070 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377055 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} err="failed to get container status \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": rpc error: code = NotFound desc = could not find container \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": container with ID starting with 93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e not found: ID does not exist" Jun 11 12:58:46.377125 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377070 2577 scope.go:117] "RemoveContainer" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.377251 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377237 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} err="failed to get container status \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": rpc error: code = NotFound desc = could not find container \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": container with ID starting with 00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07 not found: ID does not exist" Jun 11 12:58:46.377285 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377252 2577 scope.go:117] "RemoveContainer" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.377430 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377415 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} err="failed to get container status \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": rpc error: code = NotFound desc = could not find container \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": container with ID starting with 18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514 not found: ID does not exist" Jun 11 12:58:46.377473 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377431 2577 scope.go:117] "RemoveContainer" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.377599 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377582 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} err="failed to get container status \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": rpc error: code = NotFound desc = could not find container \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": container with ID starting with cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6 not found: ID does not exist" Jun 11 12:58:46.377640 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377600 2577 scope.go:117] "RemoveContainer" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.377828 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377812 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} err="failed to get container status \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": rpc error: code = NotFound desc = could not find container \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": container with ID starting with 6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12 not found: ID does not exist" Jun 11 12:58:46.377883 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.377828 2577 scope.go:117] "RemoveContainer" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.378056 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378031 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626"} err="failed to get container status \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": rpc error: code = NotFound desc = could not find container \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": container with ID starting with d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626 not found: ID does not exist" Jun 11 12:58:46.378100 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378056 2577 scope.go:117] "RemoveContainer" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.378295 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378277 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} err="failed to get container status \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": rpc error: code = NotFound desc = could not find container \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": container with ID starting with 446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b not found: ID does not exist" Jun 11 12:58:46.378333 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378297 2577 scope.go:117] "RemoveContainer" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.378490 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378475 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} err="failed to get container status \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": rpc error: code = NotFound desc = could not find container \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": container with ID starting with 93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e not found: ID does not exist" Jun 11 12:58:46.378536 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378489 2577 scope.go:117] "RemoveContainer" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.378711 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378694 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} err="failed to get container status \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": rpc error: code = NotFound desc = could not find container \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": container with ID starting with 00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07 not found: ID does not exist" Jun 11 12:58:46.378771 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378712 2577 scope.go:117] "RemoveContainer" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.378897 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378881 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} err="failed to get container status \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": rpc error: code = NotFound desc = could not find container \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": container with ID starting with 18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514 not found: ID does not exist" Jun 11 12:58:46.378934 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.378898 2577 scope.go:117] "RemoveContainer" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.379071 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379054 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} err="failed to get container status \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": rpc error: code = NotFound desc = could not find container \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": container with ID starting with cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6 not found: ID does not exist" Jun 11 12:58:46.379112 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379073 2577 scope.go:117] "RemoveContainer" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.379270 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379253 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} err="failed to get container status \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": rpc error: code = NotFound desc = could not find container \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": container with ID starting with 6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12 not found: ID does not exist" Jun 11 12:58:46.379309 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379272 2577 scope.go:117] "RemoveContainer" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.379455 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379439 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626"} err="failed to get container status \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": rpc error: code = NotFound desc = could not find container \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": container with ID starting with d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626 not found: ID does not exist" Jun 11 12:58:46.379494 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379455 2577 scope.go:117] "RemoveContainer" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.379634 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379618 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} err="failed to get container status \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": rpc error: code = NotFound desc = could not find container \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": container with ID starting with 446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b not found: ID does not exist" Jun 11 12:58:46.379700 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379634 2577 scope.go:117] "RemoveContainer" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.379860 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379842 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} err="failed to get container status \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": rpc error: code = NotFound desc = could not find container \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": container with ID starting with 93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e not found: ID does not exist" Jun 11 12:58:46.379919 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.379862 2577 scope.go:117] "RemoveContainer" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.380070 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380055 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} err="failed to get container status \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": rpc error: code = NotFound desc = could not find container \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": container with ID starting with 00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07 not found: ID does not exist" Jun 11 12:58:46.380117 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380070 2577 scope.go:117] "RemoveContainer" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.380228 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380212 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} err="failed to get container status \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": rpc error: code = NotFound desc = could not find container \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": container with ID starting with 18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514 not found: ID does not exist" Jun 11 12:58:46.380228 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380228 2577 scope.go:117] "RemoveContainer" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.380389 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380374 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} err="failed to get container status \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": rpc error: code = NotFound desc = could not find container \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": container with ID starting with cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6 not found: ID does not exist" Jun 11 12:58:46.380430 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380389 2577 scope.go:117] "RemoveContainer" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.380556 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380542 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} err="failed to get container status \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": rpc error: code = NotFound desc = could not find container \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": container with ID starting with 6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12 not found: ID does not exist" Jun 11 12:58:46.380606 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380558 2577 scope.go:117] "RemoveContainer" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.380782 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380764 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626"} err="failed to get container status \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": rpc error: code = NotFound desc = could not find container \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": container with ID starting with d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626 not found: ID does not exist" Jun 11 12:58:46.380825 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380784 2577 scope.go:117] "RemoveContainer" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.380956 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380936 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} err="failed to get container status \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": rpc error: code = NotFound desc = could not find container \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": container with ID starting with 446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b not found: ID does not exist" Jun 11 12:58:46.381008 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.380959 2577 scope.go:117] "RemoveContainer" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.381193 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381171 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} err="failed to get container status \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": rpc error: code = NotFound desc = could not find container \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": container with ID starting with 93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e not found: ID does not exist" Jun 11 12:58:46.381267 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381196 2577 scope.go:117] "RemoveContainer" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.381429 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381412 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} err="failed to get container status \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": rpc error: code = NotFound desc = could not find container \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": container with ID starting with 00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07 not found: ID does not exist" Jun 11 12:58:46.381489 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381430 2577 scope.go:117] "RemoveContainer" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.381657 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381633 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} err="failed to get container status \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": rpc error: code = NotFound desc = could not find container \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": container with ID starting with 18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514 not found: ID does not exist" Jun 11 12:58:46.381657 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381679 2577 scope.go:117] "RemoveContainer" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.381885 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381868 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} err="failed to get container status \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": rpc error: code = NotFound desc = could not find container \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": container with ID starting with cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6 not found: ID does not exist" Jun 11 12:58:46.381955 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.381886 2577 scope.go:117] "RemoveContainer" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.382128 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382099 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} err="failed to get container status \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": rpc error: code = NotFound desc = could not find container \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": container with ID starting with 6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12 not found: ID does not exist" Jun 11 12:58:46.382195 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382130 2577 scope.go:117] "RemoveContainer" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.382350 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382332 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626"} err="failed to get container status \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": rpc error: code = NotFound desc = could not find container \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": container with ID starting with d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626 not found: ID does not exist" Jun 11 12:58:46.382399 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382352 2577 scope.go:117] "RemoveContainer" containerID="446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b" Jun 11 12:58:46.382549 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382535 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b"} err="failed to get container status \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": rpc error: code = NotFound desc = could not find container \"446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b\": container with ID starting with 446cdcde463a4b2035af7ace2c3ef64e171744d08c0bc83e5de91d077145177b not found: ID does not exist" Jun 11 12:58:46.382593 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382549 2577 scope.go:117] "RemoveContainer" containerID="93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e" Jun 11 12:58:46.382749 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382731 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e"} err="failed to get container status \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": rpc error: code = NotFound desc = could not find container \"93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e\": container with ID starting with 93bbf5859f01037b891b412b439c5af37b26f3c1ec08aae6ef3579d5b44c044e not found: ID does not exist" Jun 11 12:58:46.382798 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382749 2577 scope.go:117] "RemoveContainer" containerID="00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07" Jun 11 12:58:46.382937 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382920 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07"} err="failed to get container status \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": rpc error: code = NotFound desc = could not find container \"00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07\": container with ID starting with 00216299b26d17bf3d5a8e4009f08705b020ed633f507ab1ff5ea223ad4f7a07 not found: ID does not exist" Jun 11 12:58:46.382999 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.382938 2577 scope.go:117] "RemoveContainer" containerID="18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514" Jun 11 12:58:46.383163 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.383141 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514"} err="failed to get container status \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": rpc error: code = NotFound desc = could not find container \"18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514\": container with ID starting with 18133a622a6dc337c0d46ed8ed4c1b99ca52d5b671a30c1d30529142338b6514 not found: ID does not exist" Jun 11 12:58:46.383223 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.383164 2577 scope.go:117] "RemoveContainer" containerID="cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6" Jun 11 12:58:46.383433 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.383406 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6"} err="failed to get container status \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": rpc error: code = NotFound desc = could not find container \"cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6\": container with ID starting with cc26379189fbb573af77ebfd50ae4387ebcecd4afd9800831012873321cfc7c6 not found: ID does not exist" Jun 11 12:58:46.383517 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.383432 2577 scope.go:117] "RemoveContainer" containerID="6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12" Jun 11 12:58:46.383816 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.383795 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12"} err="failed to get container status \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": rpc error: code = NotFound desc = could not find container \"6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12\": container with ID starting with 6a87ac7293205e59210719057b3b435157f83f2f2167fd6284519fcdcd690d12 not found: ID does not exist" Jun 11 12:58:46.383816 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.383816 2577 scope.go:117] "RemoveContainer" containerID="d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626" Jun 11 12:58:46.384163 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.384131 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626"} err="failed to get container status \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": rpc error: code = NotFound desc = could not find container \"d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626\": container with ID starting with d36ec859fa2f470fda3bc4a8703d8d38c801c0e439ec32cd096970161e9be626 not found: ID does not exist" Jun 11 12:58:46.384906 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.384889 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:58:46.385134 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385123 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="init-config-reloader" Jun 11 12:58:46.385176 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385137 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="init-config-reloader" Jun 11 12:58:46.385176 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385150 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="thanos-sidecar" Jun 11 12:58:46.385176 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385157 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="thanos-sidecar" Jun 11 12:58:46.385176 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385168 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy" Jun 11 12:58:46.385176 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385174 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385184 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-web" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385190 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-web" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385201 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="prometheus" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385206 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="prometheus" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385215 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="config-reloader" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385224 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="config-reloader" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385234 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-thanos" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385240 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-thanos" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385274 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="prometheus" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385282 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-thanos" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385288 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="thanos-sidecar" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385296 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385304 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="config-reloader" Jun 11 12:58:46.385313 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.385309 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" containerName="kube-rbac-proxy-web" Jun 11 12:58:46.390551 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.390535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.393650 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.393631 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 12:58:46.393774 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.393687 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 12:58:46.393918 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.393898 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 12:58:46.393977 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.393905 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 12:58:46.393977 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.393973 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 12:58:46.394088 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.393922 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 12:58:46.394088 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.393975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 12:58:46.394187 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394101 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zjxt2\"" Jun 11 12:58:46.394235 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394216 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 12:58:46.394439 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394426 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 12:58:46.394531 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394511 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 12:58:46.394642 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 12:58:46.394738 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394726 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 12:58:46.394829 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394739 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95s6qga7rqidd\"" Jun 11 12:58:46.394829 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.394753 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 12:58:46.399334 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.399316 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 12:58:46.404224 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.404206 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 12:58:46.412550 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.412524 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:58:46.441595 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441595 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-config\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l9fk\" (UniqueName: \"kubernetes.io/projected/5d4230af-ba32-4957-985f-b431652e0f6a-kube-api-access-7l9fk\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441795 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441952 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441952 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4230af-ba32-4957-985f-b431652e0f6a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441952 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.441952 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442075 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442075 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.441986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442075 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.442025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4230af-ba32-4957-985f-b431652e0f6a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442075 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.442053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442306 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.442100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442306 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.442117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442306 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.442136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442306 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.442157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.442306 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.442195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.542772 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.542772 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543020 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543020 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543020 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543020 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543020 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-config\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543020 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.542934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l9fk\" (UniqueName: \"kubernetes.io/projected/5d4230af-ba32-4957-985f-b431652e0f6a-kube-api-access-7l9fk\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543284 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4230af-ba32-4957-985f-b431652e0f6a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4230af-ba32-4957-985f-b431652e0f6a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543560 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543928 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.543928 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.543823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.545926 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.545394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.546157 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.546133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.546298 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.546245 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.546748 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.546690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.546748 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.546699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.546748 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.546735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.547114 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.547090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.547246 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.547135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.547246 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.547210 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-config\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.547619 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.547587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.547772 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.547747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.548332 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.548307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.548479 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.548452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4230af-ba32-4957-985f-b431652e0f6a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.548636 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.548620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4230af-ba32-4957-985f-b431652e0f6a-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.548964 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.548946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d4230af-ba32-4957-985f-b431652e0f6a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.549075 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.549059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d4230af-ba32-4957-985f-b431652e0f6a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.552830 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.552811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l9fk\" (UniqueName: \"kubernetes.io/projected/5d4230af-ba32-4957-985f-b431652e0f6a-kube-api-access-7l9fk\") pod \"prometheus-k8s-0\" (UID: \"5d4230af-ba32-4957-985f-b431652e0f6a\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.700283 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.700186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:58:46.834608 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:46.834501 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 12:58:46.837101 ip-10-0-135-157 kubenswrapper[2577]: W0611 12:58:46.837073 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4230af_ba32_4957_985f_b431652e0f6a.slice/crio-0bfa81cc1f1d8bb5bbdeb4f22b37bdc4672680dbeadff07cf69088e98dcfb80e WatchSource:0}: Error finding container 0bfa81cc1f1d8bb5bbdeb4f22b37bdc4672680dbeadff07cf69088e98dcfb80e: Status 404 returned error can't find the container with id 0bfa81cc1f1d8bb5bbdeb4f22b37bdc4672680dbeadff07cf69088e98dcfb80e Jun 11 12:58:47.330429 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:47.330400 2577 generic.go:356] "Generic (PLEG): container finished" podID="5d4230af-ba32-4957-985f-b431652e0f6a" containerID="a49371a490b861eee43bf87a287ed0450e9c53f5b504c1ac19320b243028c9f8" exitCode=0 Jun 11 12:58:47.330814 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:47.330440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerDied","Data":"a49371a490b861eee43bf87a287ed0450e9c53f5b504c1ac19320b243028c9f8"} Jun 11 12:58:47.330814 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:47.330488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerStarted","Data":"0bfa81cc1f1d8bb5bbdeb4f22b37bdc4672680dbeadff07cf69088e98dcfb80e"} Jun 11 12:58:48.186258 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.186221 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b174164-0650-481d-8f15-6e4da70d7cd5" path="/var/lib/kubelet/pods/8b174164-0650-481d-8f15-6e4da70d7cd5/volumes" Jun 11 12:58:48.337373 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.337334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerStarted","Data":"b07dcaceb549777cae696f58712b52e0d5744fbcd32c44e3d411bf7fcd378c4a"} Jun 11 12:58:48.337730 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.337416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerStarted","Data":"010ee1472f1aaad1ce920bdc9ce04543689bd28ace2c01ae7314d5fc8d2e76d9"} Jun 11 12:58:48.337730 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.337459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerStarted","Data":"4fc3046518a42102cab1f64d462a9301e453cadb03dd9afedbdab16a4cf8872b"} Jun 11 12:58:48.337730 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.337494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerStarted","Data":"62f5bec6de985377e6639316531344c565899aa2d47715082161ac678d260653"} Jun 11 12:58:48.337730 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.337531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerStarted","Data":"92184fdbae0d49a46144f9a279622d30262e2292134680da9936acc46f822d4e"} Jun 11 12:58:48.337730 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.337565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4230af-ba32-4957-985f-b431652e0f6a","Type":"ContainerStarted","Data":"3161dcde8796a4780f7b3a7ce4063c60a010ac356debf2176b3bd182981a01cf"} Jun 11 12:58:48.368746 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:48.368684 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.349803852 podStartE2EDuration="2.368644074s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.840222ms" isStatefulPod=false podCreationTimestamp="2026-06-11 12:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:58:48.367143657 +0000 UTC m=+346.674445326" watchObservedRunningTime="2026-06-11 12:58:48.368644074 +0000 UTC m=+346.675945713" Jun 11 12:58:51.701186 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:58:51.701097 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:59:46.701246 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:59:46.701207 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:59:46.716102 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:59:46.716075 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 12:59:47.552481 ip-10-0-135-157 kubenswrapper[2577]: I0611 12:59:47.552456 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 13:01:15.281445 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.281412 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2"] Jun 11 13:01:15.284824 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.284807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.288432 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.288402 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 13:01:15.288580 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.288458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 13:01:15.288635 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.288594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 13:01:15.288712 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.288696 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 13:01:15.289098 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.289081 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6fdmw\"" Jun 11 13:01:15.309000 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.308967 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2"] Jun 11 13:01:15.374488 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.374445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.374698 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.374504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.374698 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.374535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-manifests\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.374698 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.374552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slf4h\" (UniqueName: \"kubernetes.io/projected/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-kube-api-access-slf4h\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.374698 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.374575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-tmp\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.475761 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.475710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-tmp\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.475919 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.475881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.475968 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.475949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.476020 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.476005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-manifests\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.476064 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.476035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slf4h\" (UniqueName: \"kubernetes.io/projected/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-kube-api-access-slf4h\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.476389 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.476361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-manifests\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.478034 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.478013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-tmp\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.478338 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.478319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.478338 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.478331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.484197 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.484172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slf4h\" (UniqueName: \"kubernetes.io/projected/bb8d8914-8a58-40f8-97ef-4c7fd5d462c0-kube-api-access-slf4h\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-v4ch2\" (UID: \"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.594518 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.594476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:15.721138 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.721105 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2"] Jun 11 13:01:15.726499 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:01:15.726469 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8d8914_8a58_40f8_97ef_4c7fd5d462c0.slice/crio-ac6ceeda81ec8b808ad3c67381d634246cff4e408792727a3b7897fc32d9e5b5 WatchSource:0}: Error finding container ac6ceeda81ec8b808ad3c67381d634246cff4e408792727a3b7897fc32d9e5b5: Status 404 returned error can't find the container with id ac6ceeda81ec8b808ad3c67381d634246cff4e408792727a3b7897fc32d9e5b5 Jun 11 13:01:15.728273 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.728256 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:01:15.834089 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:15.834052 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" event={"ID":"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0","Type":"ContainerStarted","Data":"ac6ceeda81ec8b808ad3c67381d634246cff4e408792727a3b7897fc32d9e5b5"} Jun 11 13:01:19.849552 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:19.849508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" event={"ID":"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0","Type":"ContainerStarted","Data":"e06fba205bb6c74a5ad79abcb8aa5d771267ab67659c87389d72bd2bf8a8f67c"} Jun 11 13:01:20.854894 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:20.854861 2577 generic.go:356] "Generic (PLEG): container finished" podID="bb8d8914-8a58-40f8-97ef-4c7fd5d462c0" containerID="e06fba205bb6c74a5ad79abcb8aa5d771267ab67659c87389d72bd2bf8a8f67c" exitCode=0 Jun 11 13:01:20.855288 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:20.854907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" event={"ID":"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0","Type":"ContainerDied","Data":"e06fba205bb6c74a5ad79abcb8aa5d771267ab67659c87389d72bd2bf8a8f67c"} Jun 11 13:01:21.860806 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:21.860770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" event={"ID":"bb8d8914-8a58-40f8-97ef-4c7fd5d462c0","Type":"ContainerStarted","Data":"ac12a8f1d892157423937a21dc0d2447e9aae22bbc8da736e379eb8cfecab1b7"} Jun 11 13:01:21.861208 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:21.861006 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:32.866009 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:32.865981 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" Jun 11 13:01:32.910223 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:32.910158 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-v4ch2" podStartSLOduration=13.338983782 podStartE2EDuration="17.910138682s" totalImagesPullingTime="3.664167349s" totalInitContainerRuntime="906.987551ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:21.88295861 +0000 UTC m=+500.190260261" watchObservedRunningTime="2026-06-11 13:01:32.910138682 +0000 UTC m=+511.217440314" Jun 11 13:01:45.490760 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.490725 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt"] Jun 11 13:01:45.502943 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.502905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.504702 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.504673 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt"] Jun 11 13:01:45.506849 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.506827 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 13:01:45.506987 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.506964 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6kvxz\"" Jun 11 13:01:45.507100 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.506857 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:01:45.507163 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.506910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 13:01:45.507222 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.506912 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 13:01:45.507278 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.506851 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 13:01:45.622310 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.622268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq86n\" (UniqueName: \"kubernetes.io/projected/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-kube-api-access-zq86n\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.622310 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.622310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-metrics-cert\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.622566 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.622334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-cert\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.622566 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.622382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-manager-config\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.723238 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.723198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq86n\" (UniqueName: \"kubernetes.io/projected/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-kube-api-access-zq86n\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.723412 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.723247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-metrics-cert\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.723412 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.723281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-cert\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.723412 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.723308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-manager-config\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.724012 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.723979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-manager-config\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.725904 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.725883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-cert\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.725971 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.725883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-metrics-cert\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.741726 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.741650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq86n\" (UniqueName: \"kubernetes.io/projected/7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe-kube-api-access-zq86n\") pod \"lws-controller-manager-6747887fbc-n4gzt\" (UID: \"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe\") " pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.813842 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.813801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:45.941346 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:45.941310 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt"] Jun 11 13:01:45.944973 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:01:45.944943 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7132bb87_c6f0_4bb9_8d2f_f7c98c8bc8fe.slice/crio-78b9579f96fe9c9572b3070a7c415fffd120668969a174bf0e0745d2aeb76e29 WatchSource:0}: Error finding container 78b9579f96fe9c9572b3070a7c415fffd120668969a174bf0e0745d2aeb76e29: Status 404 returned error can't find the container with id 78b9579f96fe9c9572b3070a7c415fffd120668969a174bf0e0745d2aeb76e29 Jun 11 13:01:46.944734 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:46.944699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" event={"ID":"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe","Type":"ContainerStarted","Data":"78b9579f96fe9c9572b3070a7c415fffd120668969a174bf0e0745d2aeb76e29"} Jun 11 13:01:49.958565 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:49.958488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" event={"ID":"7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe","Type":"ContainerStarted","Data":"d940236aacd67fcc3114f3e23c7ef676c6532d603ec6242b9a82671c64a1a726"} Jun 11 13:01:49.958974 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:49.958629 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:01:49.978852 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:49.978802 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" podStartSLOduration=1.904022922 podStartE2EDuration="4.978787459s" totalImagesPullingTime="3.074764537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:49.977201034 +0000 UTC m=+528.284502668" watchObservedRunningTime="2026-06-11 13:01:49.978787459 +0000 UTC m=+528.286089092" Jun 11 13:01:58.452254 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.452217 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7cf4859678-hl2nj"] Jun 11 13:01:58.455362 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.455341 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.460006 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.459983 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 13:01:58.460100 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.460034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vnp8c\"" Jun 11 13:01:58.471855 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.471832 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cf4859678-hl2nj"] Jun 11 13:01:58.633886 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.633836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6b57adaf-cfb7-4b41-802d-913446cf9c48-redirect-config\") pod \"dashboard-redirect-7cf4859678-hl2nj\" (UID: \"6b57adaf-cfb7-4b41-802d-913446cf9c48\") " pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.633886 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.633899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvtj\" (UniqueName: \"kubernetes.io/projected/6b57adaf-cfb7-4b41-802d-913446cf9c48-kube-api-access-pwvtj\") pod \"dashboard-redirect-7cf4859678-hl2nj\" (UID: \"6b57adaf-cfb7-4b41-802d-913446cf9c48\") " pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.734632 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.734539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvtj\" (UniqueName: \"kubernetes.io/projected/6b57adaf-cfb7-4b41-802d-913446cf9c48-kube-api-access-pwvtj\") pod \"dashboard-redirect-7cf4859678-hl2nj\" (UID: \"6b57adaf-cfb7-4b41-802d-913446cf9c48\") " pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.734813 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.734646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6b57adaf-cfb7-4b41-802d-913446cf9c48-redirect-config\") pod \"dashboard-redirect-7cf4859678-hl2nj\" (UID: \"6b57adaf-cfb7-4b41-802d-913446cf9c48\") " pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.735386 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.735366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6b57adaf-cfb7-4b41-802d-913446cf9c48-redirect-config\") pod \"dashboard-redirect-7cf4859678-hl2nj\" (UID: \"6b57adaf-cfb7-4b41-802d-913446cf9c48\") " pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.750814 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.750793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvtj\" (UniqueName: \"kubernetes.io/projected/6b57adaf-cfb7-4b41-802d-913446cf9c48-kube-api-access-pwvtj\") pod \"dashboard-redirect-7cf4859678-hl2nj\" (UID: \"6b57adaf-cfb7-4b41-802d-913446cf9c48\") " pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.764673 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.764638 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" Jun 11 13:01:58.908405 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.908378 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cf4859678-hl2nj"] Jun 11 13:01:58.910394 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:01:58.910359 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b57adaf_cfb7_4b41_802d_913446cf9c48.slice/crio-4f47f744e4b6c5e9e0e78eb3f00365dc0cedc6cf5a5d4d03f8195e0ba6aaa2cd WatchSource:0}: Error finding container 4f47f744e4b6c5e9e0e78eb3f00365dc0cedc6cf5a5d4d03f8195e0ba6aaa2cd: Status 404 returned error can't find the container with id 4f47f744e4b6c5e9e0e78eb3f00365dc0cedc6cf5a5d4d03f8195e0ba6aaa2cd Jun 11 13:01:58.991710 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:01:58.991600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" event={"ID":"6b57adaf-cfb7-4b41-802d-913446cf9c48","Type":"ContainerStarted","Data":"4f47f744e4b6c5e9e0e78eb3f00365dc0cedc6cf5a5d4d03f8195e0ba6aaa2cd"} Jun 11 13:02:00.964230 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:00.964196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6747887fbc-n4gzt" Jun 11 13:02:04.015862 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:04.015832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" event={"ID":"6b57adaf-cfb7-4b41-802d-913446cf9c48","Type":"ContainerStarted","Data":"964deff3c81f455c7f176bf3fe8f411ea611a4f73c3f5231105588590de00429"} Jun 11 13:02:04.034787 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:04.034737 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7cf4859678-hl2nj" podStartSLOduration=1.782532701 podStartE2EDuration="6.034721462s" totalImagesPullingTime="4.252188761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:02:04.032627708 +0000 UTC m=+542.339929354" watchObservedRunningTime="2026-06-11 13:02:04.034721462 +0000 UTC m=+542.342023095" Jun 11 13:02:15.125607 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.125577 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6"] Jun 11 13:02:15.129811 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.129793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.132500 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.132476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pz2wr\"" Jun 11 13:02:15.132500 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.132495 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 13:02:15.132675 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.132520 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 13:02:15.132675 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.132556 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 13:02:15.144997 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.144976 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6"] Jun 11 13:02:15.160156 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160295 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q44bc\" (UniqueName: \"kubernetes.io/projected/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-kube-api-access-q44bc\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160295 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160295 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160295 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160295 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160508 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160508 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.160508 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.160396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261017 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.260978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q44bc\" (UniqueName: \"kubernetes.io/projected/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-kube-api-access-q44bc\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261590 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261590 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261590 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261903 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261903 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.261903 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.261854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.263632 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.263611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.263885 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.263863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.271930 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.271903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q44bc\" (UniqueName: \"kubernetes.io/projected/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-kube-api-access-q44bc\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.272136 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.272118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33fdfb2-1c55-4221-96e9-74e8aa41bb29-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795w6sh6\" (UID: \"d33fdfb2-1c55-4221-96e9-74e8aa41bb29\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.439464 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.439361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:15.571650 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:15.571620 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6"] Jun 11 13:02:15.574442 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:02:15.574414 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33fdfb2_1c55_4221_96e9_74e8aa41bb29.slice/crio-dae4368e51d5756065c071cb3874343cfd2bdb2147bec00aef729fefb4e3ec14 WatchSource:0}: Error finding container dae4368e51d5756065c071cb3874343cfd2bdb2147bec00aef729fefb4e3ec14: Status 404 returned error can't find the container with id dae4368e51d5756065c071cb3874343cfd2bdb2147bec00aef729fefb4e3ec14 Jun 11 13:02:16.059375 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:16.059340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" event={"ID":"d33fdfb2-1c55-4221-96e9-74e8aa41bb29","Type":"ContainerStarted","Data":"dae4368e51d5756065c071cb3874343cfd2bdb2147bec00aef729fefb4e3ec14"} Jun 11 13:02:19.024122 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:19.024065 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:02:19.024422 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:19.024150 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:02:19.024422 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:19.024178 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:02:20.077119 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:20.077082 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" event={"ID":"d33fdfb2-1c55-4221-96e9-74e8aa41bb29","Type":"ContainerStarted","Data":"bf269ce9b8d7be9961698c20222d36652c3b73e22e33333f837b5af072420f14"} Jun 11 13:02:20.098541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:20.098489 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" podStartSLOduration=1.650997073 podStartE2EDuration="5.098474766s" totalImagesPullingTime="3.447477693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:02:20.09749171 +0000 UTC m=+558.404793343" watchObservedRunningTime="2026-06-11 13:02:20.098474766 +0000 UTC m=+558.405776399" Jun 11 13:02:20.440514 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:20.440422 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:20.445413 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:20.445386 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:21.080911 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:21.080877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:21.082072 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:21.082050 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795w6sh6" Jun 11 13:02:37.503540 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.503506 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hl79"] Jun 11 13:02:37.528015 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.527976 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hl79"] Jun 11 13:02:37.528162 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.528074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" Jun 11 13:02:37.530735 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.530708 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 13:02:37.530877 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.530708 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 13:02:37.531733 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.531713 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zqlpn\"" Jun 11 13:02:37.659273 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.659236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8cvn\" (UniqueName: \"kubernetes.io/projected/42957097-2ea1-4d47-97a2-10cfff9835e0-kube-api-access-b8cvn\") pod \"kuadrant-operator-catalog-9hl79\" (UID: \"42957097-2ea1-4d47-97a2-10cfff9835e0\") " pod="kuadrant-system/kuadrant-operator-catalog-9hl79" Jun 11 13:02:37.760618 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.760542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8cvn\" (UniqueName: \"kubernetes.io/projected/42957097-2ea1-4d47-97a2-10cfff9835e0-kube-api-access-b8cvn\") pod \"kuadrant-operator-catalog-9hl79\" (UID: \"42957097-2ea1-4d47-97a2-10cfff9835e0\") " pod="kuadrant-system/kuadrant-operator-catalog-9hl79" Jun 11 13:02:37.768793 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.768759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8cvn\" (UniqueName: \"kubernetes.io/projected/42957097-2ea1-4d47-97a2-10cfff9835e0-kube-api-access-b8cvn\") pod \"kuadrant-operator-catalog-9hl79\" (UID: \"42957097-2ea1-4d47-97a2-10cfff9835e0\") " pod="kuadrant-system/kuadrant-operator-catalog-9hl79" Jun 11 13:02:37.836838 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.836802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" Jun 11 13:02:37.864572 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.864542 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hl79"] Jun 11 13:02:37.960928 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:37.960899 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hl79"] Jun 11 13:02:37.963822 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:02:37.963792 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42957097_2ea1_4d47_97a2_10cfff9835e0.slice/crio-11cb525ba30f7f204e559ff35168bf4b4064908b7f3dcd265c20febc6bd405a6 WatchSource:0}: Error finding container 11cb525ba30f7f204e559ff35168bf4b4064908b7f3dcd265c20febc6bd405a6: Status 404 returned error can't find the container with id 11cb525ba30f7f204e559ff35168bf4b4064908b7f3dcd265c20febc6bd405a6 Jun 11 13:02:38.074445 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.074416 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9prhh"] Jun 11 13:02:38.078890 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.078875 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:38.088302 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.088264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9prhh"] Jun 11 13:02:38.144530 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.144496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" event={"ID":"42957097-2ea1-4d47-97a2-10cfff9835e0","Type":"ContainerStarted","Data":"11cb525ba30f7f204e559ff35168bf4b4064908b7f3dcd265c20febc6bd405a6"} Jun 11 13:02:38.164025 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.163991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24m47\" (UniqueName: \"kubernetes.io/projected/4987c578-eb08-44b7-8d80-95621c1aa12d-kube-api-access-24m47\") pod \"kuadrant-operator-catalog-9prhh\" (UID: \"4987c578-eb08-44b7-8d80-95621c1aa12d\") " pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:38.265396 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.265357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24m47\" (UniqueName: \"kubernetes.io/projected/4987c578-eb08-44b7-8d80-95621c1aa12d-kube-api-access-24m47\") pod \"kuadrant-operator-catalog-9prhh\" (UID: \"4987c578-eb08-44b7-8d80-95621c1aa12d\") " pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:38.274243 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.274203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24m47\" (UniqueName: \"kubernetes.io/projected/4987c578-eb08-44b7-8d80-95621c1aa12d-kube-api-access-24m47\") pod \"kuadrant-operator-catalog-9prhh\" (UID: \"4987c578-eb08-44b7-8d80-95621c1aa12d\") " pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:38.388030 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.387953 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:38.520887 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:38.520859 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9prhh"] Jun 11 13:02:38.525387 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:02:38.525362 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4987c578_eb08_44b7_8d80_95621c1aa12d.slice/crio-ca016d9122a3fd80ff06583cbda183f3f1c64c182c5836c434eec722a4c8b094 WatchSource:0}: Error finding container ca016d9122a3fd80ff06583cbda183f3f1c64c182c5836c434eec722a4c8b094: Status 404 returned error can't find the container with id ca016d9122a3fd80ff06583cbda183f3f1c64c182c5836c434eec722a4c8b094 Jun 11 13:02:39.150385 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:39.150349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" event={"ID":"4987c578-eb08-44b7-8d80-95621c1aa12d","Type":"ContainerStarted","Data":"ca016d9122a3fd80ff06583cbda183f3f1c64c182c5836c434eec722a4c8b094"} Jun 11 13:02:41.160193 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.160151 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" event={"ID":"42957097-2ea1-4d47-97a2-10cfff9835e0","Type":"ContainerStarted","Data":"e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466"} Jun 11 13:02:41.160657 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.160205 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" podUID="42957097-2ea1-4d47-97a2-10cfff9835e0" containerName="registry-server" containerID="cri-o://e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466" gracePeriod=2 Jun 11 13:02:41.161926 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.161901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" event={"ID":"4987c578-eb08-44b7-8d80-95621c1aa12d","Type":"ContainerStarted","Data":"4737a2acc6e508d16b54f4c735e2f3b9f01267d3efc411d3de0a212fa2899412"} Jun 11 13:02:41.177859 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.177816 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" podStartSLOduration=1.874166158 podStartE2EDuration="4.177801758s" totalImagesPullingTime="2.3036356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:02:41.176348149 +0000 UTC m=+579.483649782" watchObservedRunningTime="2026-06-11 13:02:41.177801758 +0000 UTC m=+579.485103390" Jun 11 13:02:41.192175 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.192128 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" podStartSLOduration=1.44723021 podStartE2EDuration="3.192111286s" totalImagesPullingTime="1.744881076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:02:41.19076231 +0000 UTC m=+579.498063942" watchObservedRunningTime="2026-06-11 13:02:41.192111286 +0000 UTC m=+579.499412918" Jun 11 13:02:41.401694 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.401652 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" Jun 11 13:02:41.494434 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.494341 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8cvn\" (UniqueName: \"kubernetes.io/projected/42957097-2ea1-4d47-97a2-10cfff9835e0-kube-api-access-b8cvn\") pod \"42957097-2ea1-4d47-97a2-10cfff9835e0\" (UID: \"42957097-2ea1-4d47-97a2-10cfff9835e0\") " Jun 11 13:02:41.496621 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.496594 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42957097-2ea1-4d47-97a2-10cfff9835e0-kube-api-access-b8cvn" (OuterVolumeSpecName: "kube-api-access-b8cvn") pod "42957097-2ea1-4d47-97a2-10cfff9835e0" (UID: "42957097-2ea1-4d47-97a2-10cfff9835e0"). InnerVolumeSpecName "kube-api-access-b8cvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:02:41.595592 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:41.595539 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8cvn\" (UniqueName: \"kubernetes.io/projected/42957097-2ea1-4d47-97a2-10cfff9835e0-kube-api-access-b8cvn\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:02:42.167072 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.167038 2577 generic.go:356] "Generic (PLEG): container finished" podID="42957097-2ea1-4d47-97a2-10cfff9835e0" containerID="e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466" exitCode=0 Jun 11 13:02:42.167541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.167087 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" Jun 11 13:02:42.167541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.167118 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" event={"ID":"42957097-2ea1-4d47-97a2-10cfff9835e0","Type":"ContainerDied","Data":"e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466"} Jun 11 13:02:42.167541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.167169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9hl79" event={"ID":"42957097-2ea1-4d47-97a2-10cfff9835e0","Type":"ContainerDied","Data":"11cb525ba30f7f204e559ff35168bf4b4064908b7f3dcd265c20febc6bd405a6"} Jun 11 13:02:42.167541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.167191 2577 scope.go:117] "RemoveContainer" containerID="e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466" Jun 11 13:02:42.177762 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.177746 2577 scope.go:117] "RemoveContainer" containerID="e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466" Jun 11 13:02:42.178022 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:02:42.178004 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466\": container with ID starting with e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466 not found: ID does not exist" containerID="e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466" Jun 11 13:02:42.178074 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.178031 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466"} err="failed to get container status \"e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466\": rpc error: code = NotFound desc = could not find container \"e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466\": container with ID starting with e5970e033ab873a704772f981e535cc426cb1c66fd20fb07489c29fd186f4466 not found: ID does not exist" Jun 11 13:02:42.190746 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.190724 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hl79"] Jun 11 13:02:42.196601 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:42.196581 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9hl79"] Jun 11 13:02:44.185745 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:44.185707 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42957097-2ea1-4d47-97a2-10cfff9835e0" path="/var/lib/kubelet/pods/42957097-2ea1-4d47-97a2-10cfff9835e0/volumes" Jun 11 13:02:48.388279 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:48.388225 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:48.388727 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:48.388304 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:48.409958 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:48.409927 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:02:49.216235 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:02:49.216201 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9prhh" Jun 11 13:03:02.156450 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:02.156426 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 13:03:02.156842 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:02.156770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 13:03:17.106177 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.106136 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf"] Jun 11 13:03:17.112934 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.106570 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42957097-2ea1-4d47-97a2-10cfff9835e0" containerName="registry-server" Jun 11 13:03:17.112934 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.106589 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="42957097-2ea1-4d47-97a2-10cfff9835e0" containerName="registry-server" Jun 11 13:03:17.112934 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.106688 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="42957097-2ea1-4d47-97a2-10cfff9835e0" containerName="registry-server" Jun 11 13:03:17.113603 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.113582 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" Jun 11 13:03:17.116979 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.116958 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r4jb2\"" Jun 11 13:03:17.117274 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.117255 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 13:03:17.138862 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.138832 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf"] Jun 11 13:03:17.200612 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.200571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qksl5\" (UniqueName: \"kubernetes.io/projected/db14a80f-aa2a-4457-a2e7-0f742653118c-kube-api-access-qksl5\") pod \"dns-operator-controller-manager-864dd78c4c-nvbgf\" (UID: \"db14a80f-aa2a-4457-a2e7-0f742653118c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" Jun 11 13:03:17.301496 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.301461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qksl5\" (UniqueName: \"kubernetes.io/projected/db14a80f-aa2a-4457-a2e7-0f742653118c-kube-api-access-qksl5\") pod \"dns-operator-controller-manager-864dd78c4c-nvbgf\" (UID: \"db14a80f-aa2a-4457-a2e7-0f742653118c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" Jun 11 13:03:17.323916 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.323884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qksl5\" (UniqueName: \"kubernetes.io/projected/db14a80f-aa2a-4457-a2e7-0f742653118c-kube-api-access-qksl5\") pod \"dns-operator-controller-manager-864dd78c4c-nvbgf\" (UID: \"db14a80f-aa2a-4457-a2e7-0f742653118c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" Jun 11 13:03:17.423796 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.423703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" Jun 11 13:03:17.595686 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:17.595017 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf"] Jun 11 13:03:17.611873 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:03:17.611828 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb14a80f_aa2a_4457_a2e7_0f742653118c.slice/crio-d9bcf12adf532618180bd6edd72d85512d4782ea23d41e5c4efc1ffbe6f6361c WatchSource:0}: Error finding container d9bcf12adf532618180bd6edd72d85512d4782ea23d41e5c4efc1ffbe6f6361c: Status 404 returned error can't find the container with id d9bcf12adf532618180bd6edd72d85512d4782ea23d41e5c4efc1ffbe6f6361c Jun 11 13:03:18.304030 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:18.303985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" event={"ID":"db14a80f-aa2a-4457-a2e7-0f742653118c","Type":"ContainerStarted","Data":"d9bcf12adf532618180bd6edd72d85512d4782ea23d41e5c4efc1ffbe6f6361c"} Jun 11 13:03:20.314814 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.314777 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" event={"ID":"db14a80f-aa2a-4457-a2e7-0f742653118c","Type":"ContainerStarted","Data":"0ad15a5d078b87cbd29eb43e1aaad4629d39e312a66648d0dd92f882c3d0c6b4"} Jun 11 13:03:20.315223 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.314912 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" Jun 11 13:03:20.340481 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.340445 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf"] Jun 11 13:03:20.344856 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.344796 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" podStartSLOduration=1.308994812 podStartE2EDuration="3.344777806s" totalImagesPullingTime="2.035782994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:03:20.343955055 +0000 UTC m=+618.651256690" watchObservedRunningTime="2026-06-11 13:03:20.344777806 +0000 UTC m=+618.652079443" Jun 11 13:03:20.349591 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.349560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" Jun 11 13:03:20.352981 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.352956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fsv8p\"" Jun 11 13:03:20.360524 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.360500 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf"] Jun 11 13:03:20.429918 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.429872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmgcs\" (UniqueName: \"kubernetes.io/projected/e9f9e1e3-1e09-4cff-b542-aa881f40502f-kube-api-access-rmgcs\") pod \"authorino-operator-75cc8d5cb7-t9dsf\" (UID: \"e9f9e1e3-1e09-4cff-b542-aa881f40502f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" Jun 11 13:03:20.531447 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.531402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmgcs\" (UniqueName: \"kubernetes.io/projected/e9f9e1e3-1e09-4cff-b542-aa881f40502f-kube-api-access-rmgcs\") pod \"authorino-operator-75cc8d5cb7-t9dsf\" (UID: \"e9f9e1e3-1e09-4cff-b542-aa881f40502f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" Jun 11 13:03:20.554181 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.554148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmgcs\" (UniqueName: \"kubernetes.io/projected/e9f9e1e3-1e09-4cff-b542-aa881f40502f-kube-api-access-rmgcs\") pod \"authorino-operator-75cc8d5cb7-t9dsf\" (UID: \"e9f9e1e3-1e09-4cff-b542-aa881f40502f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" Jun 11 13:03:20.660886 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.660784 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" Jun 11 13:03:20.801602 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:20.801542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf"] Jun 11 13:03:20.804314 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:03:20.804286 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f9e1e3_1e09_4cff_b542_aa881f40502f.slice/crio-ee306ee442ebb86fb7fe8794c9bd4d00720b299a2fa6616f5d1f4ca5a762a6f3 WatchSource:0}: Error finding container ee306ee442ebb86fb7fe8794c9bd4d00720b299a2fa6616f5d1f4ca5a762a6f3: Status 404 returned error can't find the container with id ee306ee442ebb86fb7fe8794c9bd4d00720b299a2fa6616f5d1f4ca5a762a6f3 Jun 11 13:03:21.320165 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:21.320131 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" event={"ID":"e9f9e1e3-1e09-4cff-b542-aa881f40502f","Type":"ContainerStarted","Data":"ee306ee442ebb86fb7fe8794c9bd4d00720b299a2fa6616f5d1f4ca5a762a6f3"} Jun 11 13:03:24.334483 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:24.334447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" event={"ID":"e9f9e1e3-1e09-4cff-b542-aa881f40502f","Type":"ContainerStarted","Data":"8a27969b3ee5ad065d61f0fe00d748d0e0b14a81e6a57022df38ef7bf571afec"} Jun 11 13:03:24.334920 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:24.334569 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" Jun 11 13:03:27.375753 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.375690 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" podStartSLOduration=4.812217145 podStartE2EDuration="7.375659254s" totalImagesPullingTime="2.563442109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:03:24.358277378 +0000 UTC m=+622.665579032" watchObservedRunningTime="2026-06-11 13:03:27.375659254 +0000 UTC m=+625.682960887" Jun 11 13:03:27.376124 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.376074 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk"] Jun 11 13:03:27.378973 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.378957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.381715 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.381691 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t6b8c\"" Jun 11 13:03:27.381844 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.381697 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 13:03:27.382496 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.382479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 13:03:27.402531 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.402498 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk"] Jun 11 13:03:27.488864 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.488823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/131b8ba0-297c-44b2-9d39-ffc8551fb25b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.489057 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.488868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz58q\" (UniqueName: \"kubernetes.io/projected/131b8ba0-297c-44b2-9d39-ffc8551fb25b-kube-api-access-wz58q\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.489057 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.488908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/131b8ba0-297c-44b2-9d39-ffc8551fb25b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.589978 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.589948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/131b8ba0-297c-44b2-9d39-ffc8551fb25b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.590141 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.589990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz58q\" (UniqueName: \"kubernetes.io/projected/131b8ba0-297c-44b2-9d39-ffc8551fb25b-kube-api-access-wz58q\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.590141 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.590026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/131b8ba0-297c-44b2-9d39-ffc8551fb25b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.590218 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:27.590177 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 13:03:27.590254 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:27.590246 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131b8ba0-297c-44b2-9d39-ffc8551fb25b-plugin-serving-cert podName:131b8ba0-297c-44b2-9d39-ffc8551fb25b nodeName:}" failed. No retries permitted until 2026-06-11 13:03:28.090230392 +0000 UTC m=+626.397532008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/131b8ba0-297c-44b2-9d39-ffc8551fb25b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zb6wk" (UID: "131b8ba0-297c-44b2-9d39-ffc8551fb25b") : secret "plugin-serving-cert" not found Jun 11 13:03:27.590644 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.590626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/131b8ba0-297c-44b2-9d39-ffc8551fb25b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:27.600051 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:27.600030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz58q\" (UniqueName: \"kubernetes.io/projected/131b8ba0-297c-44b2-9d39-ffc8551fb25b-kube-api-access-wz58q\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:28.093392 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:28.093336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/131b8ba0-297c-44b2-9d39-ffc8551fb25b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:28.095775 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:28.095744 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/131b8ba0-297c-44b2-9d39-ffc8551fb25b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zb6wk\" (UID: \"131b8ba0-297c-44b2-9d39-ffc8551fb25b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:28.287278 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:28.287232 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" Jun 11 13:03:28.410849 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:28.410824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk"] Jun 11 13:03:28.413291 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:03:28.413264 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod131b8ba0_297c_44b2_9d39_ffc8551fb25b.slice/crio-ed0715f15874f27e3df8a5a765a394ded84fad257c4e2e73897851e5147345a8 WatchSource:0}: Error finding container ed0715f15874f27e3df8a5a765a394ded84fad257c4e2e73897851e5147345a8: Status 404 returned error can't find the container with id ed0715f15874f27e3df8a5a765a394ded84fad257c4e2e73897851e5147345a8 Jun 11 13:03:29.360892 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:29.360861 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" event={"ID":"131b8ba0-297c-44b2-9d39-ffc8551fb25b","Type":"ContainerStarted","Data":"ed0715f15874f27e3df8a5a765a394ded84fad257c4e2e73897851e5147345a8"} Jun 11 13:03:31.323468 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:31.323434 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nvbgf" Jun 11 13:03:35.341098 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:35.341065 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t9dsf" Jun 11 13:03:37.633929 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.633895 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt"] Jun 11 13:03:37.640679 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.640646 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:37.645088 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.645062 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfjw2\"" Jun 11 13:03:37.652553 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.652524 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt"] Jun 11 13:03:37.680294 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.680256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:37.680473 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.680319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vct5\" (UniqueName: \"kubernetes.io/projected/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-kube-api-access-2vct5\") pod \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:37.781223 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.781186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:37.781417 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.781240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vct5\" (UniqueName: \"kubernetes.io/projected/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-kube-api-access-2vct5\") pod \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:37.781674 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.781628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:37.801581 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.801543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vct5\" (UniqueName: \"kubernetes.io/projected/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-kube-api-access-2vct5\") pod \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:37.956143 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:37.956043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:38.110502 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.110468 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt"] Jun 11 13:03:38.133255 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.133223 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt"] Jun 11 13:03:38.145091 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.145051 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv"] Jun 11 13:03:38.150147 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.150113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:38.184654 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.184604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bwfxv\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:38.184859 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.184722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbcjz\" (UniqueName: \"kubernetes.io/projected/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-kube-api-access-jbcjz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bwfxv\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:38.188468 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.188441 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv"] Jun 11 13:03:38.285548 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.285422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbcjz\" (UniqueName: \"kubernetes.io/projected/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-kube-api-access-jbcjz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bwfxv\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:38.285749 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.285601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bwfxv\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:38.286084 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.286062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bwfxv\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:38.311731 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.311698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbcjz\" (UniqueName: \"kubernetes.io/projected/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-kube-api-access-jbcjz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bwfxv\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:38.463033 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:38.462992 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:52.028770 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:52.028744 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv"] Jun 11 13:03:52.031086 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:03:52.031059 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc62c2ed_8a7b_4150_8bdf_ed98e79aeca8.slice/crio-61302be9f6337686d17d69a51c1f14b6f991047a236a9fd3e1a7d7c97ad900d2 WatchSource:0}: Error finding container 61302be9f6337686d17d69a51c1f14b6f991047a236a9fd3e1a7d7c97ad900d2: Status 404 returned error can't find the container with id 61302be9f6337686d17d69a51c1f14b6f991047a236a9fd3e1a7d7c97ad900d2 Jun 11 13:03:52.477764 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:52.477728 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" event={"ID":"131b8ba0-297c-44b2-9d39-ffc8551fb25b","Type":"ContainerStarted","Data":"80f807db68f2e24f2437bcda692844fe578b6ce23dc4c4c5f52192685a000c1f"} Jun 11 13:03:52.479056 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:52.479000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" event={"ID":"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8","Type":"ContainerStarted","Data":"61302be9f6337686d17d69a51c1f14b6f991047a236a9fd3e1a7d7c97ad900d2"} Jun 11 13:03:52.494460 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:52.494413 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zb6wk" podStartSLOduration=1.647097881 podStartE2EDuration="25.49438226s" totalImagesPullingTime="23.847284379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:03:52.492744263 +0000 UTC m=+650.800045888" watchObservedRunningTime="2026-06-11 13:03:52.49438226 +0000 UTC m=+650.801683892" Jun 11 13:03:54.441552 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:54.441510 2577 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-nb4xt_kuadrant-system_d44733e5-82c1-4fc9-bcbb-1577f2ce8507_0(7d29875094080df5f94eea79d45505ccdd83cf1f4a458500a6caa129f1320be0): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-nb4xt to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 11 13:03:54.441875 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:54.441587 2577 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-nb4xt_kuadrant-system_d44733e5-82c1-4fc9-bcbb-1577f2ce8507_0(7d29875094080df5f94eea79d45505ccdd83cf1f4a458500a6caa129f1320be0): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-nb4xt to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:54.487964 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.487924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:54.490232 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:54.490201 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" is forbidden: User \"system:node:ip-10-0-135-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-157.ec2.internal' and this object" podUID="d44733e5-82c1-4fc9-bcbb-1577f2ce8507" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:54.597970 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.597935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:54.600379 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:54.600353 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" is forbidden: User \"system:node:ip-10-0-135-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-157.ec2.internal' and this object" podUID="d44733e5-82c1-4fc9-bcbb-1577f2ce8507" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:54.738314 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.738236 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-extensions-socket-volume\") pod \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " Jun 11 13:03:54.738453 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.738316 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vct5\" (UniqueName: \"kubernetes.io/projected/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-kube-api-access-2vct5\") pod \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\" (UID: \"d44733e5-82c1-4fc9-bcbb-1577f2ce8507\") " Jun 11 13:03:54.738493 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.738469 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d44733e5-82c1-4fc9-bcbb-1577f2ce8507" (UID: "d44733e5-82c1-4fc9-bcbb-1577f2ce8507"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:54.740319 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.740294 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-kube-api-access-2vct5" (OuterVolumeSpecName: "kube-api-access-2vct5") pod "d44733e5-82c1-4fc9-bcbb-1577f2ce8507" (UID: "d44733e5-82c1-4fc9-bcbb-1577f2ce8507"). InnerVolumeSpecName "kube-api-access-2vct5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:03:54.839105 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.839065 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vct5\" (UniqueName: \"kubernetes.io/projected/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-kube-api-access-2vct5\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:03:54.839105 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:54.839102 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44733e5-82c1-4fc9-bcbb-1577f2ce8507-extensions-socket-volume\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:03:55.491874 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:55.491844 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:55.494389 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:55.494358 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" is forbidden: User \"system:node:ip-10-0-135-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-157.ec2.internal' and this object" podUID="d44733e5-82c1-4fc9-bcbb-1577f2ce8507" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:55.499532 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:03:55.499503 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-nb4xt\" is forbidden: User \"system:node:ip-10-0-135-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-157.ec2.internal' and this object" podUID="d44733e5-82c1-4fc9-bcbb-1577f2ce8507" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nb4xt" Jun 11 13:03:56.188802 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:56.188762 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d44733e5-82c1-4fc9-bcbb-1577f2ce8507" path="/var/lib/kubelet/pods/d44733e5-82c1-4fc9-bcbb-1577f2ce8507/volumes" Jun 11 13:03:59.513134 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:59.513101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" event={"ID":"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8","Type":"ContainerStarted","Data":"5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d"} Jun 11 13:03:59.513612 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:59.513200 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:03:59.532253 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:03:59.532204 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" podStartSLOduration=15.237571552 podStartE2EDuration="21.532189769s" totalImagesPullingTime="6.294618217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:03:59.530740504 +0000 UTC m=+657.838042139" watchObservedRunningTime="2026-06-11 13:03:59.532189769 +0000 UTC m=+657.839491402" Jun 11 13:04:10.519360 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:10.519330 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:04:22.732114 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:22.732076 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv"] Jun 11 13:04:22.732593 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:22.732325 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" podUID="fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" containerName="manager" containerID="cri-o://5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d" gracePeriod=10 Jun 11 13:04:22.981391 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:22.981360 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:04:22.983414 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:22.983367 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-extensions-socket-volume\") pod \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " Jun 11 13:04:22.983501 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:22.983437 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbcjz\" (UniqueName: \"kubernetes.io/projected/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-kube-api-access-jbcjz\") pod \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\" (UID: \"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8\") " Jun 11 13:04:22.983804 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:22.983780 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" (UID: "fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:04:22.985412 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:22.985384 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-kube-api-access-jbcjz" (OuterVolumeSpecName: "kube-api-access-jbcjz") pod "fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" (UID: "fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8"). InnerVolumeSpecName "kube-api-access-jbcjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:04:23.084243 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.084197 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-extensions-socket-volume\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:04:23.084243 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.084234 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbcjz\" (UniqueName: \"kubernetes.io/projected/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8-kube-api-access-jbcjz\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:04:23.617020 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.616983 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" containerID="5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d" exitCode=0 Jun 11 13:04:23.617188 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.617032 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" Jun 11 13:04:23.617188 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.617047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" event={"ID":"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8","Type":"ContainerDied","Data":"5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d"} Jun 11 13:04:23.617188 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.617148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv" event={"ID":"fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8","Type":"ContainerDied","Data":"61302be9f6337686d17d69a51c1f14b6f991047a236a9fd3e1a7d7c97ad900d2"} Jun 11 13:04:23.617188 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.617179 2577 scope.go:117] "RemoveContainer" containerID="5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d" Jun 11 13:04:23.626071 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.626050 2577 scope.go:117] "RemoveContainer" containerID="5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d" Jun 11 13:04:23.626334 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:04:23.626316 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d\": container with ID starting with 5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d not found: ID does not exist" containerID="5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d" Jun 11 13:04:23.626381 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.626343 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d"} err="failed to get container status \"5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d\": rpc error: code = NotFound desc = could not find container \"5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d\": container with ID starting with 5bcf9b7cc972dc526961436fddd4e7eafbfba10e0ab906364b0b7bbd4301e11d not found: ID does not exist" Jun 11 13:04:23.642309 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.642274 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv"] Jun 11 13:04:23.647509 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:23.647479 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bwfxv"] Jun 11 13:04:24.187141 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:24.187109 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" path="/var/lib/kubelet/pods/fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8/volumes" Jun 11 13:04:26.886843 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.886803 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl"] Jun 11 13:04:26.887205 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.887121 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" containerName="manager" Jun 11 13:04:26.887205 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.887134 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" containerName="manager" Jun 11 13:04:26.887205 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.887186 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc62c2ed-8a7b-4150-8bdf-ed98e79aeca8" containerName="manager" Jun 11 13:04:26.891784 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.891761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.895593 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.895565 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rpmpr\"" Jun 11 13:04:26.907429 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.907403 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl"] Jun 11 13:04:26.909879 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.909857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.909999 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.909889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a554933-ea09-4949-a34e-18acf0e4327e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.909999 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.909909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a554933-ea09-4949-a34e-18acf0e4327e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.909999 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.909938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.909999 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.909995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.910161 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.910027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a554933-ea09-4949-a34e-18acf0e4327e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.910161 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.910055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.910161 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.910087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8n8m\" (UniqueName: \"kubernetes.io/projected/5a554933-ea09-4949-a34e-18acf0e4327e-kube-api-access-t8n8m\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:26.910161 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:26.910110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011202 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a554933-ea09-4949-a34e-18acf0e4327e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011383 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011383 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8n8m\" (UniqueName: \"kubernetes.io/projected/5a554933-ea09-4949-a34e-18acf0e4327e-kube-api-access-t8n8m\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011462 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011505 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011505 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a554933-ea09-4949-a34e-18acf0e4327e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011603 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a554933-ea09-4949-a34e-18acf0e4327e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011603 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011746 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011746 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011746 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011925 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.011925 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.011923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.012243 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.012226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a554933-ea09-4949-a34e-18acf0e4327e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.013713 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.013693 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a554933-ea09-4949-a34e-18acf0e4327e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.013817 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.013735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a554933-ea09-4949-a34e-18acf0e4327e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.020355 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.020333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8n8m\" (UniqueName: \"kubernetes.io/projected/5a554933-ea09-4949-a34e-18acf0e4327e-kube-api-access-t8n8m\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.020953 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.020934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a554933-ea09-4949-a34e-18acf0e4327e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h7qzl\" (UID: \"5a554933-ea09-4949-a34e-18acf0e4327e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.202229 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.202124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:27.345041 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.345010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl"] Jun 11 13:04:27.346150 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:04:27.346117 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a554933_ea09_4949_a34e_18acf0e4327e.slice/crio-ebb89312584b4de021b4d76ce82f99abd6486a1b366602bf74c5ef14fc6894a2 WatchSource:0}: Error finding container ebb89312584b4de021b4d76ce82f99abd6486a1b366602bf74c5ef14fc6894a2: Status 404 returned error can't find the container with id ebb89312584b4de021b4d76ce82f99abd6486a1b366602bf74c5ef14fc6894a2 Jun 11 13:04:27.348187 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.348151 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:04:27.348267 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.348222 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:04:27.348267 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.348250 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:04:27.635471 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.635436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" event={"ID":"5a554933-ea09-4949-a34e-18acf0e4327e","Type":"ContainerStarted","Data":"1e07eaa805bf2fd2c822081685e90a673389e78109764a2fe1c6a481ca455185"} Jun 11 13:04:27.635675 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.635517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" event={"ID":"5a554933-ea09-4949-a34e-18acf0e4327e","Type":"ContainerStarted","Data":"ebb89312584b4de021b4d76ce82f99abd6486a1b366602bf74c5ef14fc6894a2"} Jun 11 13:04:27.657452 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:27.657396 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" podStartSLOduration=1.6573789890000001 podStartE2EDuration="1.657378989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:04:27.656231589 +0000 UTC m=+685.963533224" watchObservedRunningTime="2026-06-11 13:04:27.657378989 +0000 UTC m=+685.964680622" Jun 11 13:04:28.203091 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:28.203061 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:28.207828 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:28.207801 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:28.640506 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:28.640476 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:28.641630 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:28.641608 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:04:30.965142 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:30.965110 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zmdg6"] Jun 11 13:04:30.967731 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:30.967713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zmdg6" Jun 11 13:04:30.970136 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:30.970114 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sz9tv\"" Jun 11 13:04:30.976154 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:30.976127 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zmdg6"] Jun 11 13:04:31.047886 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:31.047850 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f65g4\" (UniqueName: \"kubernetes.io/projected/2f1d4d30-a55a-4b2b-aa79-a8460cb435ac-kube-api-access-f65g4\") pod \"authorino-58cd955675-zmdg6\" (UID: \"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac\") " pod="kuadrant-system/authorino-58cd955675-zmdg6" Jun 11 13:04:31.149057 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:31.149026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f65g4\" (UniqueName: \"kubernetes.io/projected/2f1d4d30-a55a-4b2b-aa79-a8460cb435ac-kube-api-access-f65g4\") pod \"authorino-58cd955675-zmdg6\" (UID: \"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac\") " pod="kuadrant-system/authorino-58cd955675-zmdg6" Jun 11 13:04:31.158029 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:31.157991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f65g4\" (UniqueName: \"kubernetes.io/projected/2f1d4d30-a55a-4b2b-aa79-a8460cb435ac-kube-api-access-f65g4\") pod \"authorino-58cd955675-zmdg6\" (UID: \"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac\") " pod="kuadrant-system/authorino-58cd955675-zmdg6" Jun 11 13:04:31.277230 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:31.277139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zmdg6" Jun 11 13:04:31.407229 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:31.407198 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zmdg6"] Jun 11 13:04:31.409395 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:04:31.409366 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f1d4d30_a55a_4b2b_aa79_a8460cb435ac.slice/crio-39368c6a2bfa24b186be8b29f2048bdba982a8bec1b3efc16ab291fa1baa2dba WatchSource:0}: Error finding container 39368c6a2bfa24b186be8b29f2048bdba982a8bec1b3efc16ab291fa1baa2dba: Status 404 returned error can't find the container with id 39368c6a2bfa24b186be8b29f2048bdba982a8bec1b3efc16ab291fa1baa2dba Jun 11 13:04:31.652920 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:31.652886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zmdg6" event={"ID":"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac","Type":"ContainerStarted","Data":"39368c6a2bfa24b186be8b29f2048bdba982a8bec1b3efc16ab291fa1baa2dba"} Jun 11 13:04:35.674004 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:35.673963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zmdg6" event={"ID":"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac","Type":"ContainerStarted","Data":"af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644"} Jun 11 13:04:35.688767 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:35.688708 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zmdg6" podStartSLOduration=2.368668474 podStartE2EDuration="5.688690554s" totalImagesPullingTime="3.32002208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:04:35.6884745 +0000 UTC m=+693.995776132" watchObservedRunningTime="2026-06-11 13:04:35.688690554 +0000 UTC m=+693.995992188" Jun 11 13:04:36.147714 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:36.147683 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zmdg6"] Jun 11 13:04:37.681719 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:37.681676 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zmdg6" podUID="2f1d4d30-a55a-4b2b-aa79-a8460cb435ac" containerName="authorino" containerID="cri-o://af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644" gracePeriod=30 Jun 11 13:04:37.928050 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:37.928024 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zmdg6" Jun 11 13:04:38.014919 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.014836 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f65g4\" (UniqueName: \"kubernetes.io/projected/2f1d4d30-a55a-4b2b-aa79-a8460cb435ac-kube-api-access-f65g4\") pod \"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac\" (UID: \"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac\") " Jun 11 13:04:38.016944 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.016919 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f1d4d30-a55a-4b2b-aa79-a8460cb435ac-kube-api-access-f65g4" (OuterVolumeSpecName: "kube-api-access-f65g4") pod "2f1d4d30-a55a-4b2b-aa79-a8460cb435ac" (UID: "2f1d4d30-a55a-4b2b-aa79-a8460cb435ac"). InnerVolumeSpecName "kube-api-access-f65g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:04:38.115907 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.115861 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f65g4\" (UniqueName: \"kubernetes.io/projected/2f1d4d30-a55a-4b2b-aa79-a8460cb435ac-kube-api-access-f65g4\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:04:38.686859 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.686830 2577 generic.go:356] "Generic (PLEG): container finished" podID="2f1d4d30-a55a-4b2b-aa79-a8460cb435ac" containerID="af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644" exitCode=0 Jun 11 13:04:38.687323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.686870 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zmdg6" Jun 11 13:04:38.687323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.686874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zmdg6" event={"ID":"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac","Type":"ContainerDied","Data":"af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644"} Jun 11 13:04:38.687323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.687017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zmdg6" event={"ID":"2f1d4d30-a55a-4b2b-aa79-a8460cb435ac","Type":"ContainerDied","Data":"39368c6a2bfa24b186be8b29f2048bdba982a8bec1b3efc16ab291fa1baa2dba"} Jun 11 13:04:38.687323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.687051 2577 scope.go:117] "RemoveContainer" containerID="af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644" Jun 11 13:04:38.695175 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.695155 2577 scope.go:117] "RemoveContainer" containerID="af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644" Jun 11 13:04:38.695449 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:04:38.695432 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644\": container with ID starting with af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644 not found: ID does not exist" containerID="af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644" Jun 11 13:04:38.695495 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.695457 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644"} err="failed to get container status \"af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644\": rpc error: code = NotFound desc = could not find container \"af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644\": container with ID starting with af800782f24d0bcf4121023c01699916cac153de9812bf9d68f2297c91fe5644 not found: ID does not exist" Jun 11 13:04:38.703019 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.702996 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zmdg6"] Jun 11 13:04:38.707135 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:38.707114 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zmdg6"] Jun 11 13:04:40.186950 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:04:40.186916 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f1d4d30-a55a-4b2b-aa79-a8460cb435ac" path="/var/lib/kubelet/pods/2f1d4d30-a55a-4b2b-aa79-a8460cb435ac/volumes" Jun 11 13:05:23.994388 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:23.994356 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:05:23.994820 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:23.994709 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1d4d30-a55a-4b2b-aa79-a8460cb435ac" containerName="authorino" Jun 11 13:05:23.994820 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:23.994722 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1d4d30-a55a-4b2b-aa79-a8460cb435ac" containerName="authorino" Jun 11 13:05:23.994820 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:23.994785 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f1d4d30-a55a-4b2b-aa79-a8460cb435ac" containerName="authorino" Jun 11 13:05:23.997599 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:23.997584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:24.000860 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.000840 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 13:05:24.001365 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.001351 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 13:05:24.002309 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.002293 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 13:05:24.002398 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.002343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tpwzn\"" Jun 11 13:05:24.010168 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.010148 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:05:24.117037 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.116999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30-kube-api-access-bx8gt\") pod \"maas-keycloak-0\" (UID: \"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:24.218070 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.218027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30-kube-api-access-bx8gt\") pod \"maas-keycloak-0\" (UID: \"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:24.228485 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.228449 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30-kube-api-access-bx8gt\") pod \"maas-keycloak-0\" (UID: \"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:24.307313 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.307218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:24.440869 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.440802 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:05:24.443490 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:05:24.443463 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58d9ab1_0bdd_46d9_a7a1_1d0bfc9fdf30.slice/crio-b2212bf02b66e19fd03ec1b040ab6961a7252a085229c35f62e43fc0fc9f4331 WatchSource:0}: Error finding container b2212bf02b66e19fd03ec1b040ab6961a7252a085229c35f62e43fc0fc9f4331: Status 404 returned error can't find the container with id b2212bf02b66e19fd03ec1b040ab6961a7252a085229c35f62e43fc0fc9f4331 Jun 11 13:05:24.888311 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:24.888239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30","Type":"ContainerStarted","Data":"b2212bf02b66e19fd03ec1b040ab6961a7252a085229c35f62e43fc0fc9f4331"} Jun 11 13:05:28.909232 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:28.909197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30","Type":"ContainerStarted","Data":"3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7"} Jun 11 13:05:28.930450 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:28.930400 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.570450169 podStartE2EDuration="5.930380298s" totalImagesPullingTime="4.359930129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:05:28.928855224 +0000 UTC m=+747.236156868" watchObservedRunningTime="2026-06-11 13:05:28.930380298 +0000 UTC m=+747.237681931" Jun 11 13:05:29.308300 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:29.308227 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:29.309727 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:29.309692 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:30.308763 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:30.308701 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:31.308798 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:31.308749 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:32.308072 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:32.308013 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:33.308380 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:33.308321 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:34.308835 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:34.308781 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:34.309349 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:34.309325 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:35.308380 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:35.308325 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:36.307804 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:36.307745 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:37.307769 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:37.307719 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:38.308571 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:38.308518 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:39.307902 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:39.307849 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:40.307819 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:40.307767 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:41.308184 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:41.308137 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 11 13:05:42.425999 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:42.425964 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:42.445124 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:42.445078 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 13:05:52.432397 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:52.432362 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:05:58.186521 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.186492 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-87d8b84b7-m6sd9"] Jun 11 13:05:58.189854 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.189835 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.196351 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.196330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 13:05:58.196472 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.196402 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-25lhh\"" Jun 11 13:05:58.197249 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.197232 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 13:05:58.224168 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.224132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-87d8b84b7-m6sd9"] Jun 11 13:05:58.233738 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.233711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zmbs\" (UniqueName: \"kubernetes.io/projected/b4544c8d-4391-486f-91f7-6506f15212cb-kube-api-access-7zmbs\") pod \"maas-controller-87d8b84b7-m6sd9\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.233885 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.233766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4544c8d-4391-486f-91f7-6506f15212cb-webhook-cert\") pod \"maas-controller-87d8b84b7-m6sd9\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.335091 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.335046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zmbs\" (UniqueName: \"kubernetes.io/projected/b4544c8d-4391-486f-91f7-6506f15212cb-kube-api-access-7zmbs\") pod \"maas-controller-87d8b84b7-m6sd9\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.335279 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.335109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4544c8d-4391-486f-91f7-6506f15212cb-webhook-cert\") pod \"maas-controller-87d8b84b7-m6sd9\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.337548 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.337524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4544c8d-4391-486f-91f7-6506f15212cb-webhook-cert\") pod \"maas-controller-87d8b84b7-m6sd9\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.356841 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.356808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zmbs\" (UniqueName: \"kubernetes.io/projected/b4544c8d-4391-486f-91f7-6506f15212cb-kube-api-access-7zmbs\") pod \"maas-controller-87d8b84b7-m6sd9\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.413902 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.413869 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b7cb759cd-jcmjc"] Jun 11 13:05:58.417207 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.417191 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.433808 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.433784 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7cb759cd-jcmjc"] Jun 11 13:05:58.436147 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.436120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g268\" (UniqueName: \"kubernetes.io/projected/293a64aa-8636-4bda-98c2-1b914cf5e9f5-kube-api-access-5g268\") pod \"maas-controller-7b7cb759cd-jcmjc\" (UID: \"293a64aa-8636-4bda-98c2-1b914cf5e9f5\") " pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.436277 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.436158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/293a64aa-8636-4bda-98c2-1b914cf5e9f5-webhook-cert\") pod \"maas-controller-7b7cb759cd-jcmjc\" (UID: \"293a64aa-8636-4bda-98c2-1b914cf5e9f5\") " pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.499766 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.499649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:05:58.537042 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.537007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g268\" (UniqueName: \"kubernetes.io/projected/293a64aa-8636-4bda-98c2-1b914cf5e9f5-kube-api-access-5g268\") pod \"maas-controller-7b7cb759cd-jcmjc\" (UID: \"293a64aa-8636-4bda-98c2-1b914cf5e9f5\") " pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.537185 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.537045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/293a64aa-8636-4bda-98c2-1b914cf5e9f5-webhook-cert\") pod \"maas-controller-7b7cb759cd-jcmjc\" (UID: \"293a64aa-8636-4bda-98c2-1b914cf5e9f5\") " pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.539864 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.539837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/293a64aa-8636-4bda-98c2-1b914cf5e9f5-webhook-cert\") pod \"maas-controller-7b7cb759cd-jcmjc\" (UID: \"293a64aa-8636-4bda-98c2-1b914cf5e9f5\") " pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.545430 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.545406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g268\" (UniqueName: \"kubernetes.io/projected/293a64aa-8636-4bda-98c2-1b914cf5e9f5-kube-api-access-5g268\") pod \"maas-controller-7b7cb759cd-jcmjc\" (UID: \"293a64aa-8636-4bda-98c2-1b914cf5e9f5\") " pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.630150 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.630123 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-87d8b84b7-m6sd9"] Jun 11 13:05:58.632210 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:05:58.632183 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4544c8d_4391_486f_91f7_6506f15212cb.slice/crio-c7a586dfd07e6725a80b869fe8c7d582068e1fd1988f4416dcb17edf791915ad WatchSource:0}: Error finding container c7a586dfd07e6725a80b869fe8c7d582068e1fd1988f4416dcb17edf791915ad: Status 404 returned error can't find the container with id c7a586dfd07e6725a80b869fe8c7d582068e1fd1988f4416dcb17edf791915ad Jun 11 13:05:58.727978 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.727939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:05:58.859568 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:58.859534 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7cb759cd-jcmjc"] Jun 11 13:05:58.862748 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:05:58.862722 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293a64aa_8636_4bda_98c2_1b914cf5e9f5.slice/crio-344c141516689a9730c3d97fe29346ca5f2ff7329b8ccbacd378ed46eb51585f WatchSource:0}: Error finding container 344c141516689a9730c3d97fe29346ca5f2ff7329b8ccbacd378ed46eb51585f: Status 404 returned error can't find the container with id 344c141516689a9730c3d97fe29346ca5f2ff7329b8ccbacd378ed46eb51585f Jun 11 13:05:59.074242 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:59.074208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" event={"ID":"293a64aa-8636-4bda-98c2-1b914cf5e9f5","Type":"ContainerStarted","Data":"344c141516689a9730c3d97fe29346ca5f2ff7329b8ccbacd378ed46eb51585f"} Jun 11 13:05:59.075344 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:05:59.075319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" event={"ID":"b4544c8d-4391-486f-91f7-6506f15212cb","Type":"ContainerStarted","Data":"c7a586dfd07e6725a80b869fe8c7d582068e1fd1988f4416dcb17edf791915ad"} Jun 11 13:06:02.092393 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:02.092356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" event={"ID":"293a64aa-8636-4bda-98c2-1b914cf5e9f5","Type":"ContainerStarted","Data":"9d204c53a9635a6ac6222df5e22ae6ddfa92568b5f552d6d8932c980c23ff4ea"} Jun 11 13:06:02.092894 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:02.092448 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:06:02.093832 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:02.093805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" event={"ID":"b4544c8d-4391-486f-91f7-6506f15212cb","Type":"ContainerStarted","Data":"8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff"} Jun 11 13:06:02.093925 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:02.093867 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:06:02.117301 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:02.117257 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" podStartSLOduration=1.659543811 podStartE2EDuration="4.117244818s" totalImagesPullingTime="2.457701007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:06:02.11604406 +0000 UTC m=+780.423345689" watchObservedRunningTime="2026-06-11 13:06:02.117244818 +0000 UTC m=+780.424546451" Jun 11 13:06:02.139322 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:02.139279 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" podStartSLOduration=1.463377113 podStartE2EDuration="4.139265122s" totalImagesPullingTime="2.675888009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:06:02.138163489 +0000 UTC m=+780.445465158" watchObservedRunningTime="2026-06-11 13:06:02.139265122 +0000 UTC m=+780.446566754" Jun 11 13:06:13.105386 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.105350 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:06:13.105792 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.105446 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b7cb759cd-jcmjc" Jun 11 13:06:13.190593 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.190563 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-87d8b84b7-m6sd9"] Jun 11 13:06:13.190768 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.190742 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" podUID="b4544c8d-4391-486f-91f7-6506f15212cb" containerName="manager" containerID="cri-o://8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff" gracePeriod=30 Jun 11 13:06:13.436068 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.436045 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:06:13.473841 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.473811 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zmbs\" (UniqueName: \"kubernetes.io/projected/b4544c8d-4391-486f-91f7-6506f15212cb-kube-api-access-7zmbs\") pod \"b4544c8d-4391-486f-91f7-6506f15212cb\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " Jun 11 13:06:13.474029 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.473961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4544c8d-4391-486f-91f7-6506f15212cb-webhook-cert\") pod \"b4544c8d-4391-486f-91f7-6506f15212cb\" (UID: \"b4544c8d-4391-486f-91f7-6506f15212cb\") " Jun 11 13:06:13.476088 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.476052 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4544c8d-4391-486f-91f7-6506f15212cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b4544c8d-4391-486f-91f7-6506f15212cb" (UID: "b4544c8d-4391-486f-91f7-6506f15212cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 13:06:13.476211 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.476185 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4544c8d-4391-486f-91f7-6506f15212cb-kube-api-access-7zmbs" (OuterVolumeSpecName: "kube-api-access-7zmbs") pod "b4544c8d-4391-486f-91f7-6506f15212cb" (UID: "b4544c8d-4391-486f-91f7-6506f15212cb"). InnerVolumeSpecName "kube-api-access-7zmbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:06:13.574717 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.574654 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zmbs\" (UniqueName: \"kubernetes.io/projected/b4544c8d-4391-486f-91f7-6506f15212cb-kube-api-access-7zmbs\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:06:13.574717 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:13.574713 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4544c8d-4391-486f-91f7-6506f15212cb-webhook-cert\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:06:14.147397 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.147360 2577 generic.go:356] "Generic (PLEG): container finished" podID="b4544c8d-4391-486f-91f7-6506f15212cb" containerID="8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff" exitCode=0 Jun 11 13:06:14.147818 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.147424 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" Jun 11 13:06:14.147818 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.147426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" event={"ID":"b4544c8d-4391-486f-91f7-6506f15212cb","Type":"ContainerDied","Data":"8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff"} Jun 11 13:06:14.147818 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.147511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-87d8b84b7-m6sd9" event={"ID":"b4544c8d-4391-486f-91f7-6506f15212cb","Type":"ContainerDied","Data":"c7a586dfd07e6725a80b869fe8c7d582068e1fd1988f4416dcb17edf791915ad"} Jun 11 13:06:14.147818 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.147541 2577 scope.go:117] "RemoveContainer" containerID="8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff" Jun 11 13:06:14.155988 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.155972 2577 scope.go:117] "RemoveContainer" containerID="8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff" Jun 11 13:06:14.156224 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:06:14.156210 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff\": container with ID starting with 8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff not found: ID does not exist" containerID="8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff" Jun 11 13:06:14.156260 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.156231 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff"} err="failed to get container status \"8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff\": rpc error: code = NotFound desc = could not find container \"8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff\": container with ID starting with 8849f090ead60ec77ec6c1a2d4b238f2756cd61a9674a500cd0087e34cf000ff not found: ID does not exist" Jun 11 13:06:14.169092 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.169066 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-87d8b84b7-m6sd9"] Jun 11 13:06:14.173210 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.173185 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-87d8b84b7-m6sd9"] Jun 11 13:06:14.186934 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:14.186911 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4544c8d-4391-486f-91f7-6506f15212cb" path="/var/lib/kubelet/pods/b4544c8d-4391-486f-91f7-6506f15212cb/volumes" Jun 11 13:06:33.392948 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.392908 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8679bb98f7-zpx4h"] Jun 11 13:06:33.393541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.393411 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4544c8d-4391-486f-91f7-6506f15212cb" containerName="manager" Jun 11 13:06:33.393541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.393432 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4544c8d-4391-486f-91f7-6506f15212cb" containerName="manager" Jun 11 13:06:33.393541 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.393530 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4544c8d-4391-486f-91f7-6506f15212cb" containerName="manager" Jun 11 13:06:33.396602 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.396582 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.399166 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.399137 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 13:06:33.399166 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.399163 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jt8lg\"" Jun 11 13:06:33.412146 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.412122 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8679bb98f7-zpx4h"] Jun 11 13:06:33.547425 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.547389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-maas-api-tls\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.547609 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.547439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-openshift-service-ca\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.547609 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.547532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rfmh\" (UniqueName: \"kubernetes.io/projected/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-kube-api-access-4rfmh\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.649012 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.648926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-maas-api-tls\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.649012 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.648971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-openshift-service-ca\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.649243 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.649045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rfmh\" (UniqueName: \"kubernetes.io/projected/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-kube-api-access-4rfmh\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.649874 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.649845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-openshift-service-ca\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.651429 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.651409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-maas-api-tls\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.657347 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.657322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rfmh\" (UniqueName: \"kubernetes.io/projected/f9449b0b-96a7-4d48-bde4-a25e8b4766fa-kube-api-access-4rfmh\") pod \"maas-api-8679bb98f7-zpx4h\" (UID: \"f9449b0b-96a7-4d48-bde4-a25e8b4766fa\") " pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.707132 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.707099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:33.864434 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.864408 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8679bb98f7-zpx4h"] Jun 11 13:06:33.865966 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:06:33.865941 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9449b0b_96a7_4d48_bde4_a25e8b4766fa.slice/crio-edd9784be7156c32a28057e2f89c0cc91c252465ea5988c3f484ff7ea54f221c WatchSource:0}: Error finding container edd9784be7156c32a28057e2f89c0cc91c252465ea5988c3f484ff7ea54f221c: Status 404 returned error can't find the container with id edd9784be7156c32a28057e2f89c0cc91c252465ea5988c3f484ff7ea54f221c Jun 11 13:06:33.867358 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:33.867337 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:06:34.016491 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.016408 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hmgxq"] Jun 11 13:06:34.020935 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.020917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" Jun 11 13:06:34.023836 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.023809 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n24ph\"" Jun 11 13:06:34.023961 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.023941 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 13:06:34.031590 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.031567 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hmgxq"] Jun 11 13:06:34.127306 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.127274 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wm44z"] Jun 11 13:06:34.130574 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.130554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" Jun 11 13:06:34.141284 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.141260 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wm44z"] Jun 11 13:06:34.152669 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.152643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w6c8\" (UniqueName: \"kubernetes.io/projected/559e406b-7125-4fa5-b924-bc6c4f9eb2cc-kube-api-access-7w6c8\") pod \"payload-pre-processing-579785bc64-hmgxq\" (UID: \"559e406b-7125-4fa5-b924-bc6c4f9eb2cc\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" Jun 11 13:06:34.235070 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.235037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8679bb98f7-zpx4h" event={"ID":"f9449b0b-96a7-4d48-bde4-a25e8b4766fa","Type":"ContainerStarted","Data":"edd9784be7156c32a28057e2f89c0cc91c252465ea5988c3f484ff7ea54f221c"} Jun 11 13:06:34.253501 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.253475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9w24\" (UniqueName: \"kubernetes.io/projected/d4dc8821-1d8c-4041-bb35-a2b75e015d58-kube-api-access-m9w24\") pod \"payload-processing-699b6cd6c-wm44z\" (UID: \"d4dc8821-1d8c-4041-bb35-a2b75e015d58\") " pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" Jun 11 13:06:34.253606 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.253513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w6c8\" (UniqueName: \"kubernetes.io/projected/559e406b-7125-4fa5-b924-bc6c4f9eb2cc-kube-api-access-7w6c8\") pod \"payload-pre-processing-579785bc64-hmgxq\" (UID: \"559e406b-7125-4fa5-b924-bc6c4f9eb2cc\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" Jun 11 13:06:34.263344 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.263321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w6c8\" (UniqueName: \"kubernetes.io/projected/559e406b-7125-4fa5-b924-bc6c4f9eb2cc-kube-api-access-7w6c8\") pod \"payload-pre-processing-579785bc64-hmgxq\" (UID: \"559e406b-7125-4fa5-b924-bc6c4f9eb2cc\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" Jun 11 13:06:34.332887 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.332860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" Jun 11 13:06:34.354395 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.354357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9w24\" (UniqueName: \"kubernetes.io/projected/d4dc8821-1d8c-4041-bb35-a2b75e015d58-kube-api-access-m9w24\") pod \"payload-processing-699b6cd6c-wm44z\" (UID: \"d4dc8821-1d8c-4041-bb35-a2b75e015d58\") " pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" Jun 11 13:06:34.363794 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.363763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9w24\" (UniqueName: \"kubernetes.io/projected/d4dc8821-1d8c-4041-bb35-a2b75e015d58-kube-api-access-m9w24\") pod \"payload-processing-699b6cd6c-wm44z\" (UID: \"d4dc8821-1d8c-4041-bb35-a2b75e015d58\") " pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" Jun 11 13:06:34.441124 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.441093 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" Jun 11 13:06:34.489730 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.489697 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hmgxq"] Jun 11 13:06:34.491891 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:06:34.491824 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559e406b_7125_4fa5_b924_bc6c4f9eb2cc.slice/crio-72079a08198df50792c83d8c370d6b59545ef3b0ff3c7254ef5a5c55dcc2b992 WatchSource:0}: Error finding container 72079a08198df50792c83d8c370d6b59545ef3b0ff3c7254ef5a5c55dcc2b992: Status 404 returned error can't find the container with id 72079a08198df50792c83d8c370d6b59545ef3b0ff3c7254ef5a5c55dcc2b992 Jun 11 13:06:34.613537 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:34.613454 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wm44z"] Jun 11 13:06:34.625185 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:06:34.625154 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4dc8821_1d8c_4041_bb35_a2b75e015d58.slice/crio-68e2ce2630086fc1f83eac386336611302b4ab25e7ec6f8917ac702e1d71d0e4 WatchSource:0}: Error finding container 68e2ce2630086fc1f83eac386336611302b4ab25e7ec6f8917ac702e1d71d0e4: Status 404 returned error can't find the container with id 68e2ce2630086fc1f83eac386336611302b4ab25e7ec6f8917ac702e1d71d0e4 Jun 11 13:06:35.244458 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:35.244420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" event={"ID":"d4dc8821-1d8c-4041-bb35-a2b75e015d58","Type":"ContainerStarted","Data":"68e2ce2630086fc1f83eac386336611302b4ab25e7ec6f8917ac702e1d71d0e4"} Jun 11 13:06:35.247093 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:35.247056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" event={"ID":"559e406b-7125-4fa5-b924-bc6c4f9eb2cc","Type":"ContainerStarted","Data":"72079a08198df50792c83d8c370d6b59545ef3b0ff3c7254ef5a5c55dcc2b992"} Jun 11 13:06:37.260105 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:37.260069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8679bb98f7-zpx4h" event={"ID":"f9449b0b-96a7-4d48-bde4-a25e8b4766fa","Type":"ContainerStarted","Data":"12ed00e056c9826d5272d4b0b27b3add1d5023a9860fe124ae5100d111b5b506"} Jun 11 13:06:37.260547 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:37.260348 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:37.279711 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:37.279594 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8679bb98f7-zpx4h" podStartSLOduration=1.984749734 podStartE2EDuration="4.279572527s" totalImagesPullingTime="2.294822793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:06:37.278720671 +0000 UTC m=+815.586022304" watchObservedRunningTime="2026-06-11 13:06:37.279572527 +0000 UTC m=+815.586874160" Jun 11 13:06:38.266106 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:38.265993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" event={"ID":"d4dc8821-1d8c-4041-bb35-a2b75e015d58","Type":"ContainerStarted","Data":"d9b60ed9266e152cb3d3433b9a600d3ca1ad4793c351fe7ce5672aa821dad4d0"} Jun 11 13:06:38.266106 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:38.266098 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" Jun 11 13:06:38.267630 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:38.267604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" event={"ID":"559e406b-7125-4fa5-b924-bc6c4f9eb2cc","Type":"ContainerStarted","Data":"017d653492ba8fde7cfdcc4ffa052dae20da4f2efb7d8ed1d5356d15088e777d"} Jun 11 13:06:38.267778 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:38.267695 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" Jun 11 13:06:38.289586 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:38.289537 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" podStartSLOduration=1.060423987 podStartE2EDuration="4.28952195s" totalImagesPullingTime="3.229097963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:06:38.286753898 +0000 UTC m=+816.594055529" watchObservedRunningTime="2026-06-11 13:06:38.28952195 +0000 UTC m=+816.596823582" Jun 11 13:06:38.307551 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:38.307477 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" podStartSLOduration=1.9530844680000001 podStartE2EDuration="5.307454032s" totalImagesPullingTime="3.354369564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:06:38.305811522 +0000 UTC m=+816.613113194" watchObservedRunningTime="2026-06-11 13:06:38.307454032 +0000 UTC m=+816.614755666" Jun 11 13:06:42.286081 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:42.286051 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a554933-ea09-4949-a34e-18acf0e4327e" containerID="1e07eaa805bf2fd2c822081685e90a673389e78109764a2fe1c6a481ca455185" exitCode=0 Jun 11 13:06:42.286641 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:42.286132 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" event={"ID":"5a554933-ea09-4949-a34e-18acf0e4327e","Type":"ContainerDied","Data":"1e07eaa805bf2fd2c822081685e90a673389e78109764a2fe1c6a481ca455185"} Jun 11 13:06:42.286641 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:42.286622 2577 scope.go:117] "RemoveContainer" containerID="1e07eaa805bf2fd2c822081685e90a673389e78109764a2fe1c6a481ca455185" Jun 11 13:06:42.287749 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:42.287721 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:06:42.287811 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:42.287790 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:06:42.287846 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:42.287822 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 13:06:43.273762 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:43.273736 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8679bb98f7-zpx4h" Jun 11 13:06:43.294724 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:43.294658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" event={"ID":"5a554933-ea09-4949-a34e-18acf0e4327e","Type":"ContainerStarted","Data":"0eed22081febe5795cf7831a69aed2033b9c0c9059bca8cb5b3752c200d98b98"} Jun 11 13:06:43.640674 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:43.640627 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:06:44.202542 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:44.202510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:06:44.203767 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:44.203733 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7qzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 11 13:06:44.203902 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:44.203784 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" podUID="5a554933-ea09-4949-a34e-18acf0e4327e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 11 13:06:45.202949 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:45.202914 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7qzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 11 13:06:45.203339 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:45.202972 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" podUID="5a554933-ea09-4949-a34e-18acf0e4327e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 11 13:06:46.203059 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:46.203017 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7qzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 11 13:06:46.203439 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:46.203074 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" podUID="5a554933-ea09-4949-a34e-18acf0e4327e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 11 13:06:47.202795 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:47.202752 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h7qzl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 11 13:06:47.203011 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:47.202833 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" podUID="5a554933-ea09-4949-a34e-18acf0e4327e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 11 13:06:48.206548 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:48.206522 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:06:48.207540 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:48.207520 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h7qzl" Jun 11 13:06:49.273759 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:49.273724 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hmgxq" Jun 11 13:06:49.274195 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:06:49.273923 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-wm44z" Jun 11 13:08:02.184050 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:02.184018 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 13:08:02.184621 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:02.184602 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 13:08:47.708974 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:47.708939 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:08:47.709546 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:47.709137 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" containerID="cri-o://3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7" gracePeriod=30 Jun 11 13:08:49.752758 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.752728 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:49.860338 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.860304 2577 generic.go:356] "Generic (PLEG): container finished" podID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerID="3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7" exitCode=143 Jun 11 13:08:49.860531 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.860350 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:49.860531 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.860350 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30","Type":"ContainerDied","Data":"3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7"} Jun 11 13:08:49.860531 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.860483 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30","Type":"ContainerDied","Data":"b2212bf02b66e19fd03ec1b040ab6961a7252a085229c35f62e43fc0fc9f4331"} Jun 11 13:08:49.860531 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.860518 2577 scope.go:117] "RemoveContainer" containerID="3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7" Jun 11 13:08:49.868621 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.868600 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30-kube-api-access-bx8gt\") pod \"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30\" (UID: \"c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30\") " Jun 11 13:08:49.869489 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.869475 2577 scope.go:117] "RemoveContainer" containerID="3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7" Jun 11 13:08:49.869800 ip-10-0-135-157 kubenswrapper[2577]: E0611 13:08:49.869781 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7\": container with ID starting with 3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7 not found: ID does not exist" containerID="3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7" Jun 11 13:08:49.869872 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.869811 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7"} err="failed to get container status \"3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7\": rpc error: code = NotFound desc = could not find container \"3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7\": container with ID starting with 3319ab0ea8a9171625d7844b9fa2554ba0a1f16dc0d28c77a6617626fa0cb3b7 not found: ID does not exist" Jun 11 13:08:49.870749 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.870721 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30-kube-api-access-bx8gt" (OuterVolumeSpecName: "kube-api-access-bx8gt") pod "c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" (UID: "c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30"). InnerVolumeSpecName "kube-api-access-bx8gt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:08:49.969588 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:49.969537 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30-kube-api-access-bx8gt\") on node \"ip-10-0-135-157.ec2.internal\" DevicePath \"\"" Jun 11 13:08:50.193030 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.192997 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:08:50.200364 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.200337 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:08:50.260640 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.260599 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:08:50.261060 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.261040 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" Jun 11 13:08:50.261150 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.261062 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" Jun 11 13:08:50.261202 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.261164 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" containerName="keycloak" Jun 11 13:08:50.265605 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.265578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.269322 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.269300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 13:08:50.269879 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.269863 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 13:08:50.269935 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.269912 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 13:08:50.270029 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.270009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 13:08:50.270126 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.270109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tpwzn\"" Jun 11 13:08:50.281902 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.281875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:08:50.372944 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.372886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/99bad654-821f-4769-9100-0fc5f3f057cf-test-realms\") pod \"maas-keycloak-0\" (UID: \"99bad654-821f-4769-9100-0fc5f3f057cf\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.373132 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.372970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvt8q\" (UniqueName: \"kubernetes.io/projected/99bad654-821f-4769-9100-0fc5f3f057cf-kube-api-access-mvt8q\") pod \"maas-keycloak-0\" (UID: \"99bad654-821f-4769-9100-0fc5f3f057cf\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.474015 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.473907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/99bad654-821f-4769-9100-0fc5f3f057cf-test-realms\") pod \"maas-keycloak-0\" (UID: \"99bad654-821f-4769-9100-0fc5f3f057cf\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.474185 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.474072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvt8q\" (UniqueName: \"kubernetes.io/projected/99bad654-821f-4769-9100-0fc5f3f057cf-kube-api-access-mvt8q\") pod \"maas-keycloak-0\" (UID: \"99bad654-821f-4769-9100-0fc5f3f057cf\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.474724 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.474699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/99bad654-821f-4769-9100-0fc5f3f057cf-test-realms\") pod \"maas-keycloak-0\" (UID: \"99bad654-821f-4769-9100-0fc5f3f057cf\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.484366 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.484343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvt8q\" (UniqueName: \"kubernetes.io/projected/99bad654-821f-4769-9100-0fc5f3f057cf-kube-api-access-mvt8q\") pod \"maas-keycloak-0\" (UID: \"99bad654-821f-4769-9100-0fc5f3f057cf\") " pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.575009 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.574964 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:50.706591 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.706566 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 13:08:50.708833 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:08:50.708804 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bad654_821f_4769_9100_0fc5f3f057cf.slice/crio-1962e09fdadec2ffb61bb812d9b6f738537f24d9ef71b8c1c2724d7a58773581 WatchSource:0}: Error finding container 1962e09fdadec2ffb61bb812d9b6f738537f24d9ef71b8c1c2724d7a58773581: Status 404 returned error can't find the container with id 1962e09fdadec2ffb61bb812d9b6f738537f24d9ef71b8c1c2724d7a58773581 Jun 11 13:08:50.865718 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:50.865659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"99bad654-821f-4769-9100-0fc5f3f057cf","Type":"ContainerStarted","Data":"1962e09fdadec2ffb61bb812d9b6f738537f24d9ef71b8c1c2724d7a58773581"} Jun 11 13:08:51.874231 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:51.873692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"99bad654-821f-4769-9100-0fc5f3f057cf","Type":"ContainerStarted","Data":"2a35912370ed2f852664868db4217bf79b065baf57578cfeb57da049663374b7"} Jun 11 13:08:51.893740 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:51.893692 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.569111049 podStartE2EDuration="1.893673128s" totalImagesPullingTime="324.562079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:08:51.891760634 +0000 UTC m=+950.199062268" watchObservedRunningTime="2026-06-11 13:08:51.893673128 +0000 UTC m=+950.200974754" Jun 11 13:08:52.187583 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:52.187505 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30" path="/var/lib/kubelet/pods/c58d9ab1-0bdd-46d9-a7a1-1d0bfc9fdf30/volumes" Jun 11 13:08:52.575617 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:52.575565 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 13:08:52.577451 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:52.577413 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:08:53.576031 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:53.575979 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:08:54.576156 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:54.576106 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:08:55.575819 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:55.575759 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:08:56.576075 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:56.576025 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:08:57.575454 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:57.575406 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:08:58.576444 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:58.576384 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:08:59.576322 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:08:59.576269 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:09:00.575454 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:00.575398 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:09:00.575981 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:00.575725 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:09:01.575943 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:01.575886 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:09:02.576356 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:02.576315 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:09:03.575799 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:03.575750 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 13:09:04.705166 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:04.705112 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 13:09:04.724784 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:04.724722 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="99bad654-821f-4769-9100-0fc5f3f057cf" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 13:09:14.713073 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:14.713039 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 13:09:36.326654 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.326623 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn"] Jun 11 13:09:36.330148 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.330129 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.340275 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.340257 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 13:09:36.340438 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.340421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 13:09:36.341533 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.341517 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-248hb\"" Jun 11 13:09:36.341592 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.341538 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 13:09:36.404623 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.404591 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn"] Jun 11 13:09:36.424150 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.424118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.424323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.424159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.424323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.424206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.424323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.424239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gspz\" (UniqueName: \"kubernetes.io/projected/576d3297-2f22-4577-84b1-48134a5bafe6-kube-api-access-7gspz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.424323 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.424273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/576d3297-2f22-4577-84b1-48134a5bafe6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.424470 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.424324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.525583 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.525540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.525784 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.525600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.525784 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.525634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.525784 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.525684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.525784 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.525710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gspz\" (UniqueName: \"kubernetes.io/projected/576d3297-2f22-4577-84b1-48134a5bafe6-kube-api-access-7gspz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.525784 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.525737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/576d3297-2f22-4577-84b1-48134a5bafe6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.526109 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.526075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.526226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.526119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.526226 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.526123 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.527984 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.527961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/576d3297-2f22-4577-84b1-48134a5bafe6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.528284 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.528268 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/576d3297-2f22-4577-84b1-48134a5bafe6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.533192 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.533173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gspz\" (UniqueName: \"kubernetes.io/projected/576d3297-2f22-4577-84b1-48134a5bafe6-kube-api-access-7gspz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn\" (UID: \"576d3297-2f22-4577-84b1-48134a5bafe6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.640769 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.640656 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:36.774507 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:36.774478 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn"] Jun 11 13:09:36.776110 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:09:36.776081 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576d3297_2f22_4577_84b1_48134a5bafe6.slice/crio-f80c6f423cd0572fe17ff2e85311df80a9a273864154638b045a2fc39b03d5a3 WatchSource:0}: Error finding container f80c6f423cd0572fe17ff2e85311df80a9a273864154638b045a2fc39b03d5a3: Status 404 returned error can't find the container with id f80c6f423cd0572fe17ff2e85311df80a9a273864154638b045a2fc39b03d5a3 Jun 11 13:09:37.115176 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:37.115135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" event={"ID":"576d3297-2f22-4577-84b1-48134a5bafe6","Type":"ContainerStarted","Data":"f80c6f423cd0572fe17ff2e85311df80a9a273864154638b045a2fc39b03d5a3"} Jun 11 13:09:41.140630 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:41.140585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" event={"ID":"576d3297-2f22-4577-84b1-48134a5bafe6","Type":"ContainerStarted","Data":"23d8210099b4d7b76b27e506eff694a573da34796a4bd526976a09e97fa69e08"} Jun 11 13:09:43.149992 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:43.149956 2577 generic.go:356] "Generic (PLEG): container finished" podID="576d3297-2f22-4577-84b1-48134a5bafe6" containerID="23d8210099b4d7b76b27e506eff694a573da34796a4bd526976a09e97fa69e08" exitCode=0 Jun 11 13:09:43.150386 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:43.150007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" event={"ID":"576d3297-2f22-4577-84b1-48134a5bafe6","Type":"ContainerDied","Data":"23d8210099b4d7b76b27e506eff694a573da34796a4bd526976a09e97fa69e08"} Jun 11 13:09:45.164943 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:45.164908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" event={"ID":"576d3297-2f22-4577-84b1-48134a5bafe6","Type":"ContainerStarted","Data":"ce6d35de7bd7f5c57eb4c3bc05d30caa3fda5eedb4c7f2427519b6424d3cd2b1"} Jun 11 13:09:45.190922 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:45.188045 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" podStartSLOduration=2.260813493 podStartE2EDuration="9.188024998s" totalImagesPullingTime="5.552508304s" totalInitContainerRuntime="1.374703201s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:09:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:09:45.18454747 +0000 UTC m=+1003.491849103" watchObservedRunningTime="2026-06-11 13:09:45.188024998 +0000 UTC m=+1003.495326636" Jun 11 13:09:46.641752 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:46.641708 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:46.642166 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:46.641780 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:46.654550 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:46.654520 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:47.186377 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:47.186346 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn" Jun 11 13:09:58.799466 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:58.799427 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt"] Jun 11 13:09:58.948021 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:58.947980 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt"] Jun 11 13:09:58.948187 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:58.948084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:58.951008 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:58.950982 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 13:09:59.035021 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.034957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.035217 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.035036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.035217 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.035093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e0f53-77db-4994-bfab-6b84c341f2f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.035217 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.035126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.035217 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.035160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjn55\" (UniqueName: \"kubernetes.io/projected/ac2e0f53-77db-4994-bfab-6b84c341f2f0-kube-api-access-gjn55\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.035380 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.035258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.135965 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.135925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136173 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.135971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136173 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.136026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e0f53-77db-4994-bfab-6b84c341f2f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136173 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.136051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136173 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.136074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjn55\" (UniqueName: \"kubernetes.io/projected/ac2e0f53-77db-4994-bfab-6b84c341f2f0-kube-api-access-gjn55\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136173 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.136110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136425 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.136400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136487 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.136424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.136487 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.136458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.138369 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.138347 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2e0f53-77db-4994-bfab-6b84c341f2f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.138468 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.138446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2e0f53-77db-4994-bfab-6b84c341f2f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.144649 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.144625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjn55\" (UniqueName: \"kubernetes.io/projected/ac2e0f53-77db-4994-bfab-6b84c341f2f0-kube-api-access-gjn55\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt\" (UID: \"ac2e0f53-77db-4994-bfab-6b84c341f2f0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.258780 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.258742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" Jun 11 13:09:59.395040 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:09:59.395010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt"] Jun 11 13:09:59.397708 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:09:59.397656 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2e0f53_77db_4994_bfab_6b84c341f2f0.slice/crio-ab5c03ae1a70ba3feac3326dfaade056fe28520d3d0b3b8b3ca51ab195183ea2 WatchSource:0}: Error finding container ab5c03ae1a70ba3feac3326dfaade056fe28520d3d0b3b8b3ca51ab195183ea2: Status 404 returned error can't find the container with id ab5c03ae1a70ba3feac3326dfaade056fe28520d3d0b3b8b3ca51ab195183ea2 Jun 11 13:10:00.233848 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:00.233807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" event={"ID":"ac2e0f53-77db-4994-bfab-6b84c341f2f0","Type":"ContainerStarted","Data":"9d7b7a4f52c8bfb4c9eaf654febe3f180bc0d89a64ba003ed101ea4ca254d140"} Jun 11 13:10:00.234236 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:00.233874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt" event={"ID":"ac2e0f53-77db-4994-bfab-6b84c341f2f0","Type":"ContainerStarted","Data":"ab5c03ae1a70ba3feac3326dfaade056fe28520d3d0b3b8b3ca51ab195183ea2"} Jun 11 13:10:24.202294 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.202255 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6"] Jun 11 13:10:24.207019 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.206988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.209876 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.209851 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 13:10:24.216491 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.216466 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6"] Jun 11 13:10:24.373452 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.373418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30a2ad4-25c9-405a-a0ca-baa4f7549604-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.373452 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.373459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.373656 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.373535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.373656 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.373582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.373656 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.373630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.373780 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.373691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnnmh\" (UniqueName: \"kubernetes.io/projected/c30a2ad4-25c9-405a-a0ca-baa4f7549604-kube-api-access-dnnmh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.474474 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.474380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30a2ad4-25c9-405a-a0ca-baa4f7549604-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.474474 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.474427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.474659 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.474486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.474659 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.474524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.474659 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.474564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.474659 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.474623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnnmh\" (UniqueName: \"kubernetes.io/projected/c30a2ad4-25c9-405a-a0ca-baa4f7549604-kube-api-access-dnnmh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.474961 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.474937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.475054 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.475008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.475105 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.475060 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.476812 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.476786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c30a2ad4-25c9-405a-a0ca-baa4f7549604-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.477066 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.477050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c30a2ad4-25c9-405a-a0ca-baa4f7549604-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.483889 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.483865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnnmh\" (UniqueName: \"kubernetes.io/projected/c30a2ad4-25c9-405a-a0ca-baa4f7549604-kube-api-access-dnnmh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6\" (UID: \"c30a2ad4-25c9-405a-a0ca-baa4f7549604\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.520194 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.520164 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" Jun 11 13:10:24.663905 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:24.661069 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6"] Jun 11 13:10:25.348333 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:25.348298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" event={"ID":"c30a2ad4-25c9-405a-a0ca-baa4f7549604","Type":"ContainerStarted","Data":"53bd8a9813d8569052471da7705c63d1df23130926b768742f0c70abba91e307"} Jun 11 13:10:25.348717 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:25.348351 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6" event={"ID":"c30a2ad4-25c9-405a-a0ca-baa4f7549604","Type":"ContainerStarted","Data":"fd9970ec34844bac74bf75d738d4867866b5a5cdf76d9943366adff247120096"} Jun 11 13:10:29.583443 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.583412 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc"] Jun 11 13:10:29.587099 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.587080 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.590136 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.590108 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 13:10:29.598434 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.598407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc"] Jun 11 13:10:29.622569 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.622538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.622751 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.622591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62607c97-3885-47a4-8d7d-2188aa54807f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.622751 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.622622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgpf\" (UniqueName: \"kubernetes.io/projected/62607c97-3885-47a4-8d7d-2188aa54807f-kube-api-access-bmgpf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.622751 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.622658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.622751 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.622737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.622888 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.622756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723234 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723400 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723469 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723524 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62607c97-3885-47a4-8d7d-2188aa54807f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723575 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgpf\" (UniqueName: \"kubernetes.io/projected/62607c97-3885-47a4-8d7d-2188aa54807f-kube-api-access-bmgpf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723631 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723631 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.723970 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.724098 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.723970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.725675 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.725644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62607c97-3885-47a4-8d7d-2188aa54807f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.726027 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.726009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62607c97-3885-47a4-8d7d-2188aa54807f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.734627 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.734605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgpf\" (UniqueName: \"kubernetes.io/projected/62607c97-3885-47a4-8d7d-2188aa54807f-kube-api-access-bmgpf\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-4czfc\" (UID: \"62607c97-3885-47a4-8d7d-2188aa54807f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:29.901402 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:29.901320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:10:30.033259 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:30.033196 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc"] Jun 11 13:10:30.035546 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:10:30.035513 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62607c97_3885_47a4_8d7d_2188aa54807f.slice/crio-af039eea891cd90f9a64f7303d22bb562fb046cbe295ecb78bb92f829879116e WatchSource:0}: Error finding container af039eea891cd90f9a64f7303d22bb562fb046cbe295ecb78bb92f829879116e: Status 404 returned error can't find the container with id af039eea891cd90f9a64f7303d22bb562fb046cbe295ecb78bb92f829879116e Jun 11 13:10:30.374567 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:30.374524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" event={"ID":"62607c97-3885-47a4-8d7d-2188aa54807f","Type":"ContainerStarted","Data":"d3d29ae83852654e91a51f3dc0551c461e699468dc681409e37b077479010151"} Jun 11 13:10:30.374759 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:10:30.374591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" event={"ID":"62607c97-3885-47a4-8d7d-2188aa54807f","Type":"ContainerStarted","Data":"af039eea891cd90f9a64f7303d22bb562fb046cbe295ecb78bb92f829879116e"} Jun 11 13:11:22.628370 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:22.628332 2577 generic.go:356] "Generic (PLEG): container finished" podID="62607c97-3885-47a4-8d7d-2188aa54807f" containerID="d3d29ae83852654e91a51f3dc0551c461e699468dc681409e37b077479010151" exitCode=0 Jun 11 13:11:22.628818 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:22.628402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" event={"ID":"62607c97-3885-47a4-8d7d-2188aa54807f","Type":"ContainerDied","Data":"d3d29ae83852654e91a51f3dc0551c461e699468dc681409e37b077479010151"} Jun 11 13:11:23.635375 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:23.635341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" event={"ID":"62607c97-3885-47a4-8d7d-2188aa54807f","Type":"ContainerStarted","Data":"ea8c7a274c51c0efa48de5a0121d4ffe95975ba576a12cf3d5fd7b343e9a157d"} Jun 11 13:11:23.655434 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:23.655383 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" podStartSLOduration=2.238713219 podStartE2EDuration="54.655354863s" totalImagesPullingTime="247.637351ms" totalInitContainerRuntime="52.169004293s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:23.65423298 +0000 UTC m=+1101.961534613" watchObservedRunningTime="2026-06-11 13:11:23.655354863 +0000 UTC m=+1101.962656496" Jun 11 13:11:29.901658 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:29.901615 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:11:29.902187 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:29.901709 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:11:29.914437 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:29.914406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:11:30.680817 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:11:30.680787 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-4czfc" Jun 11 13:13:02.216786 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:13:02.216755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 13:13:02.217324 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:13:02.217169 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t6ptv_9251e5a5-1e09-45a2-9ed3-fe3649701a52/ovn-acl-logging/0.log" Jun 11 13:16:55.360195 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:16:55.360165 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6_c30a2ad4-25c9-405a-a0ca-baa4f7549604/storage-initializer/0.log" Jun 11 13:17:01.131013 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:01.130979 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cf4859678-hl2nj_6b57adaf-cfb7-4b41-802d-913446cf9c48/nginx/0.log" Jun 11 13:17:01.485397 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:01.485314 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8679bb98f7-zpx4h_f9449b0b-96a7-4d48-bde4-a25e8b4766fa/maas-api/0.log" Jun 11 13:17:01.716928 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:01.716898 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b7cb759cd-jcmjc_293a64aa-8636-4bda-98c2-1b914cf5e9f5/manager/0.log" Jun 11 13:17:02.318257 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:02.318232 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-v4ch2_bb8d8914-8a58-40f8-97ef-4c7fd5d462c0/copy-manifests/0.log" Jun 11 13:17:02.324680 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:02.324634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-v4ch2_bb8d8914-8a58-40f8-97ef-4c7fd5d462c0/manager/0.log" Jun 11 13:17:03.900033 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:03.900004 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t9dsf_e9f9e1e3-1e09-4cff-b542-aa881f40502f/manager/0.log" Jun 11 13:17:04.014537 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:04.014505 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nvbgf_db14a80f-aa2a-4457-a2e7-0f742653118c/manager/0.log" Jun 11 13:17:04.128774 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:04.128744 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zb6wk_131b8ba0-297c-44b2-9d39-ffc8551fb25b/kuadrant-console-plugin/0.log" Jun 11 13:17:04.251998 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:04.251914 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9prhh_4987c578-eb08-44b7-8d80-95621c1aa12d/registry-server/0.log" Jun 11 13:17:04.973410 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:04.973382 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w6sh6_d33fdfb2-1c55-4221-96e9-74e8aa41bb29/istio-proxy/0.log" Jun 11 13:17:05.454009 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:05.453976 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/1.log" Jun 11 13:17:05.573464 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:05.573431 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hmgxq_559e406b-7125-4fa5-b924-bc6c4f9eb2cc/payload-pre-processing/0.log" Jun 11 13:17:05.698768 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:05.698738 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wm44z_d4dc8821-1d8c-4041-bb35-a2b75e015d58/payload-processing/0.log" Jun 11 13:17:06.166439 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:06.166407 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn_576d3297-2f22-4577-84b1-48134a5bafe6/storage-initializer/0.log" Jun 11 13:17:06.173953 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:06.173928 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-k72cn_576d3297-2f22-4577-84b1-48134a5bafe6/main/0.log" Jun 11 13:17:06.411063 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:06.411031 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-fpwnt_ac2e0f53-77db-4994-bfab-6b84c341f2f0/storage-initializer/0.log" Jun 11 13:17:06.531158 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:06.531072 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c5mgq6_c30a2ad4-25c9-405a-a0ca-baa4f7549604/storage-initializer/0.log" Jun 11 13:17:06.653568 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:06.653540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4czfc_62607c97-3885-47a4-8d7d-2188aa54807f/main/0.log" Jun 11 13:17:06.670506 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:06.670481 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-4czfc_62607c97-3885-47a4-8d7d-2188aa54807f/storage-initializer/0.log" Jun 11 13:17:14.560140 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:14.560103 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gqz86_c9f74e9a-504b-4ed2-bbe3-52d31d1c5ac6/global-pull-secret-syncer/0.log" Jun 11 13:17:14.643407 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:14.643377 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l2vxz_6c88cb14-0718-49f7-9f29-ac51959cd3c7/konnectivity-agent/0.log" Jun 11 13:17:14.697772 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:14.697744 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-157.ec2.internal_a72f5a9697ad399eb9691e5a91523da3/haproxy/0.log" Jun 11 13:17:20.018488 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:20.018455 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t9dsf_e9f9e1e3-1e09-4cff-b542-aa881f40502f/manager/0.log" Jun 11 13:17:20.052218 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:20.052186 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nvbgf_db14a80f-aa2a-4457-a2e7-0f742653118c/manager/0.log" Jun 11 13:17:20.081376 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:20.081349 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zb6wk_131b8ba0-297c-44b2-9d39-ffc8551fb25b/kuadrant-console-plugin/0.log" Jun 11 13:17:20.117120 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:20.117093 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9prhh_4987c578-eb08-44b7-8d80-95621c1aa12d/registry-server/0.log" Jun 11 13:17:22.510786 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.510755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5zv9_42b45016-0d7e-4935-8cbc-abc2b16c76e5/node-exporter/0.log" Jun 11 13:17:22.534800 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.534773 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5zv9_42b45016-0d7e-4935-8cbc-abc2b16c76e5/kube-rbac-proxy/0.log" Jun 11 13:17:22.560384 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.560359 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v5zv9_42b45016-0d7e-4935-8cbc-abc2b16c76e5/init-textfile/0.log" Jun 11 13:17:22.690999 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.690968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4230af-ba32-4957-985f-b431652e0f6a/prometheus/0.log" Jun 11 13:17:22.719570 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.719534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4230af-ba32-4957-985f-b431652e0f6a/config-reloader/0.log" Jun 11 13:17:22.759498 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.759465 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4230af-ba32-4957-985f-b431652e0f6a/thanos-sidecar/0.log" Jun 11 13:17:22.784327 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.784252 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4230af-ba32-4957-985f-b431652e0f6a/kube-rbac-proxy-web/0.log" Jun 11 13:17:22.811823 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.811794 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4230af-ba32-4957-985f-b431652e0f6a/kube-rbac-proxy/0.log" Jun 11 13:17:22.837249 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.837224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4230af-ba32-4957-985f-b431652e0f6a/kube-rbac-proxy-thanos/0.log" Jun 11 13:17:22.862098 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:22.862061 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4230af-ba32-4957-985f-b431652e0f6a/init-config-reloader/0.log" Jun 11 13:17:24.912871 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:24.912833 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4"] Jun 11 13:17:24.916652 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:24.916634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:24.919730 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:24.919708 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzlpt\"/\"openshift-service-ca.crt\"" Jun 11 13:17:24.920765 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:24.920745 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nzlpt\"/\"default-dockercfg-vftqm\"" Jun 11 13:17:24.920860 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:24.920751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzlpt\"/\"kube-root-ca.crt\"" Jun 11 13:17:24.931545 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:24.931515 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4"] Jun 11 13:17:25.059102 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.059054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-sys\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.059102 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.059099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-podres\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.059312 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.059176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-lib-modules\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.059312 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.059246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-proc\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.059312 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.059261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnkf\" (UniqueName: \"kubernetes.io/projected/dd72da37-37ab-43a0-9fa7-a32829ad31cd-kube-api-access-5cnkf\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160134 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-lib-modules\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160330 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-proc\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160330 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnkf\" (UniqueName: \"kubernetes.io/projected/dd72da37-37ab-43a0-9fa7-a32829ad31cd-kube-api-access-5cnkf\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160330 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-sys\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160330 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-podres\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160330 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-proc\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160330 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-sys\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160330 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160295 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-lib-modules\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.160605 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.160396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd72da37-37ab-43a0-9fa7-a32829ad31cd-podres\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.169456 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.169401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnkf\" (UniqueName: \"kubernetes.io/projected/dd72da37-37ab-43a0-9fa7-a32829ad31cd-kube-api-access-5cnkf\") pod \"perf-node-gather-daemonset-mk8v4\" (UID: \"dd72da37-37ab-43a0-9fa7-a32829ad31cd\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.234878 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.234837 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:25.370658 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:25.370597 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4"] Jun 11 13:17:25.373421 ip-10-0-135-157 kubenswrapper[2577]: W0611 13:17:25.373393 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddd72da37_37ab_43a0_9fa7_a32829ad31cd.slice/crio-d78530672d4070ed86e3d41f49aed5885984331cc76f9aae0b71908a3880962e WatchSource:0}: Error finding container d78530672d4070ed86e3d41f49aed5885984331cc76f9aae0b71908a3880962e: Status 404 returned error can't find the container with id d78530672d4070ed86e3d41f49aed5885984331cc76f9aae0b71908a3880962e Jun 11 13:17:26.340932 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:26.340896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" event={"ID":"dd72da37-37ab-43a0-9fa7-a32829ad31cd","Type":"ContainerStarted","Data":"906b4d68c823ec6e0c1a95353c58ac5d928713f3a6423fbaf10073137092f64d"} Jun 11 13:17:26.341413 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:26.340947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" event={"ID":"dd72da37-37ab-43a0-9fa7-a32829ad31cd","Type":"ContainerStarted","Data":"d78530672d4070ed86e3d41f49aed5885984331cc76f9aae0b71908a3880962e"} Jun 11 13:17:26.341413 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:26.341055 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:26.373362 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:26.373309 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" podStartSLOduration=2.3732930039999998 podStartE2EDuration="2.373293004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:17:26.371057595 +0000 UTC m=+1464.678359251" watchObservedRunningTime="2026-06-11 13:17:26.373293004 +0000 UTC m=+1464.680594637" Jun 11 13:17:27.479713 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:27.479680 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7zwkn_ae57c229-a286-4bd4-8370-4e3095c480af/dns/0.log" Jun 11 13:17:27.506806 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:27.506777 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7zwkn_ae57c229-a286-4bd4-8370-4e3095c480af/kube-rbac-proxy/0.log" Jun 11 13:17:27.691295 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:27.691267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h79dg_1155a92d-ee4a-4f76-a8b3-73b4392e8f86/dns-node-resolver/0.log" Jun 11 13:17:28.264927 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:28.264897 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55b57c7877-trxmn_23d04d8c-e982-46ab-bbfd-c023d8d817e1/registry/0.log" Jun 11 13:17:28.269436 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:28.269403 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55b57c7877-trxmn_23d04d8c-e982-46ab-bbfd-c023d8d817e1/registry/1.log" Jun 11 13:17:28.318911 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:28.318880 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tz5pm_54faeadc-5eee-405d-a2b4-e1fb58b9bcd0/node-ca/0.log" Jun 11 13:17:29.372928 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:29.372889 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w6sh6_d33fdfb2-1c55-4221-96e9-74e8aa41bb29/istio-proxy/0.log" Jun 11 13:17:29.544448 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:29.544395 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/1.log" Jun 11 13:17:29.544879 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:29.544860 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/0.log" Jun 11 13:17:29.570554 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:29.570529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hmgxq_559e406b-7125-4fa5-b924-bc6c4f9eb2cc/payload-pre-processing/0.log" Jun 11 13:17:29.600374 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:29.600346 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wm44z_d4dc8821-1d8c-4041-bb35-a2b75e015d58/payload-processing/0.log" Jun 11 13:17:30.289086 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:30.289055 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rv994_83adae1f-e10f-4192-ab7b-ade962311ad5/serve-healthcheck-canary/0.log" Jun 11 13:17:30.974116 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:30.974078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmbw4_1b394226-0fbe-4a0f-9598-80fd3336f11e/kube-rbac-proxy/0.log" Jun 11 13:17:30.998494 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:30.998456 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmbw4_1b394226-0fbe-4a0f-9598-80fd3336f11e/exporter/0.log" Jun 11 13:17:31.025685 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:31.025610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmbw4_1b394226-0fbe-4a0f-9598-80fd3336f11e/extractor/0.log" Jun 11 13:17:32.355720 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:32.355687 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-mk8v4" Jun 11 13:17:33.542139 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:33.542105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cf4859678-hl2nj_6b57adaf-cfb7-4b41-802d-913446cf9c48/nginx/0.log" Jun 11 13:17:33.649004 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:33.648975 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8679bb98f7-zpx4h_f9449b0b-96a7-4d48-bde4-a25e8b4766fa/maas-api/0.log" Jun 11 13:17:33.720860 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:33.720833 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b7cb759cd-jcmjc_293a64aa-8636-4bda-98c2-1b914cf5e9f5/manager/0.log" Jun 11 13:17:34.006415 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:34.006391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-v4ch2_bb8d8914-8a58-40f8-97ef-4c7fd5d462c0/manager/0.log" Jun 11 13:17:34.034910 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:34.034883 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-v4ch2_bb8d8914-8a58-40f8-97ef-4c7fd5d462c0/copy-manifests/0.log" Jun 11 13:17:35.875059 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:35.875036 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6747887fbc-n4gzt_7132bb87-c6f0-4bb9-8d2f-f7c98c8bc8fe/manager/0.log" Jun 11 13:17:38.950410 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:38.950384 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w6sh6_d33fdfb2-1c55-4221-96e9-74e8aa41bb29/istio-proxy/0.log" Jun 11 13:17:39.063437 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:39.063410 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/1.log" Jun 11 13:17:39.063801 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:39.063789 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/0.log" Jun 11 13:17:39.076714 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:39.076692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hmgxq_559e406b-7125-4fa5-b924-bc6c4f9eb2cc/payload-pre-processing/0.log" Jun 11 13:17:39.094415 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:39.094389 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wm44z_d4dc8821-1d8c-4041-bb35-a2b75e015d58/payload-processing/0.log" Jun 11 13:17:40.264140 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:40.264108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w6sh6_d33fdfb2-1c55-4221-96e9-74e8aa41bb29/istio-proxy/0.log" Jun 11 13:17:40.380112 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:40.380082 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/1.log" Jun 11 13:17:40.380398 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:40.380381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/0.log" Jun 11 13:17:40.398703 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:40.398676 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hmgxq_559e406b-7125-4fa5-b924-bc6c4f9eb2cc/payload-pre-processing/0.log" Jun 11 13:17:40.417616 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:40.417588 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wm44z_d4dc8821-1d8c-4041-bb35-a2b75e015d58/payload-processing/0.log" Jun 11 13:17:42.099765 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:42.099732 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795w6sh6_d33fdfb2-1c55-4221-96e9-74e8aa41bb29/istio-proxy/0.log" Jun 11 13:17:42.217642 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:42.217603 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/1.log" Jun 11 13:17:42.218111 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:42.218095 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h7qzl_5a554933-ea09-4949-a34e-18acf0e4327e/istio-proxy/0.log" Jun 11 13:17:42.237674 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:42.237627 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hmgxq_559e406b-7125-4fa5-b924-bc6c4f9eb2cc/payload-pre-processing/0.log" Jun 11 13:17:42.254671 ip-10-0-135-157 kubenswrapper[2577]: I0611 13:17:42.254647 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wm44z_d4dc8821-1d8c-4041-bb35-a2b75e015d58/payload-processing/0.log"