Jun 05 21:18:36.657237 ip-10-0-136-105 systemd[1]: Starting Kubernetes Kubelet... Jun 05 21:18:37.041030 ip-10-0-136-105 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:18:37.041030 ip-10-0-136-105 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 21:18:37.041030 ip-10-0-136-105 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:18:37.041030 ip-10-0-136-105 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 21:18:37.041030 ip-10-0-136-105 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:18:37.042256 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.042003 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 21:18:37.048172 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048149 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:37.048172 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048167 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:37.048172 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048172 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:37.048172 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048176 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:37.048172 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048180 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048184 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048188 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048194 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048199 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048202 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048208 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048213 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048216 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048220 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048224 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048230 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048235 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048239 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048243 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048247 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048251 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048254 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048258 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048263 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:37.048483 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048266 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048270 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048273 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048278 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048282 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048286 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048290 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048294 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048298 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048302 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048305 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048309 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048314 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048318 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048324 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048328 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048333 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048337 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048342 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048346 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:37.049138 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048350 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048354 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048358 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048362 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048366 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048371 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048374 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048379 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048383 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048387 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048392 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048398 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048402 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048406 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048413 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048419 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048424 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048429 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048433 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:37.049671 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048437 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048442 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048446 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048451 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048455 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048459 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048463 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048468 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048473 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048478 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048482 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048486 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048490 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048495 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048500 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048505 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048509 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048514 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048519 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048523 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:37.050153 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048527 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048531 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048536 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048540 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048545 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048549 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048553 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048557 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048561 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048566 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048570 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048574 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048578 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048583 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048596 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.048601 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049503 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049515 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049518 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049521 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:37.050642 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049524 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049527 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049530 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049533 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049535 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049538 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049541 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049543 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049546 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049548 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049551 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049554 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049558 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049561 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049563 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049566 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049569 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049571 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049574 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049577 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:37.051258 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049579 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049582 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049584 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049588 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049590 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049593 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049595 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049599 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049601 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049605 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049608 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049611 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049614 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049617 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049619 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049622 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049624 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049627 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049629 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049632 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:37.051748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049634 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049637 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049639 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049642 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049644 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049647 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049650 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049652 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049655 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049658 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049660 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049663 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049665 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049668 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049670 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049673 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049675 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049678 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049684 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049689 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:37.052264 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049692 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049696 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049700 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049703 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049705 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049708 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049711 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049714 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049717 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049719 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049723 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049726 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049729 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049732 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049735 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049738 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049742 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049745 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049748 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:37.052735 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049751 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049754 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049757 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049760 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049762 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049765 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049768 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049770 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049773 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049775 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049778 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049781 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049784 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049786 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049790 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.049793 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050191 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050196 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050199 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050202 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:37.053230 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050205 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050208 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050210 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050213 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050216 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050218 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050221 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050224 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050227 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050229 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050232 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050234 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050237 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050240 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050242 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050245 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050247 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050250 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050252 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050255 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:37.053704 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050257 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050260 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050265 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050268 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050271 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050275 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050277 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050281 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050284 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050287 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050290 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050293 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050295 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050298 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050300 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050304 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050306 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050309 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050311 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:37.054201 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050314 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050316 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050319 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050321 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050324 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050326 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050329 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050331 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050334 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050336 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050339 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050341 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050343 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050347 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050351 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050354 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050356 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050359 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050361 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050364 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:37.054693 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050366 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050369 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050379 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050382 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050386 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050390 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050393 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050395 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050398 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050401 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050404 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050406 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050409 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050411 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050414 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050416 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050419 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050421 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050424 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050428 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:37.055204 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050431 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050435 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050438 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050441 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050443 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050447 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050449 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050452 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050455 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050457 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050460 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050462 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050464 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050467 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050470 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.050473 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050551 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050560 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050567 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050572 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050576 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 21:18:37.055750 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050579 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050584 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050588 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050591 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050595 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050598 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050602 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050605 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050608 2567 flags.go:64] FLAG: --cgroup-root="" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050612 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050615 2567 flags.go:64] FLAG: --client-ca-file="" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050618 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050621 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050625 2567 flags.go:64] FLAG: --cluster-domain="" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050628 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050631 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050639 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050643 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050646 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050650 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050653 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050657 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050661 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050664 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 21:18:37.056282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050667 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050670 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050673 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050678 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050681 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050684 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050687 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050690 2567 flags.go:64] FLAG: --enable-server="true" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050693 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050698 2567 flags.go:64] FLAG: --event-burst="100" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050701 2567 flags.go:64] FLAG: --event-qps="50" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050704 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050708 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050711 2567 flags.go:64] FLAG: --eviction-hard="" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050715 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050718 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050720 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050724 2567 flags.go:64] FLAG: --eviction-soft="" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050727 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050730 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050733 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050736 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050739 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050742 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050746 2567 flags.go:64] FLAG: --feature-gates="" Jun 05 21:18:37.056865 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050750 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050754 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050757 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050760 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050764 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050767 2567 flags.go:64] FLAG: --help="false" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050770 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050773 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050776 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050779 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050783 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050786 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050789 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050792 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050795 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050798 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050801 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050805 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050808 2567 flags.go:64] FLAG: --kube-reserved="" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050811 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050813 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050817 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050820 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050823 2567 flags.go:64] FLAG: --lock-file="" Jun 05 21:18:37.057550 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050828 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050831 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050834 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050840 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050843 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050846 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050849 2567 flags.go:64] FLAG: --logging-format="text" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050854 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050857 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050860 2567 flags.go:64] FLAG: --manifest-url="" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050863 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050867 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050870 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050894 2567 flags.go:64] FLAG: --max-pods="110" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050898 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050902 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050905 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050908 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050911 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050914 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050918 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050925 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050928 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050932 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 21:18:37.058153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050935 2567 flags.go:64] FLAG: --pod-cidr="" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050938 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050943 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050946 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050949 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050952 2567 flags.go:64] FLAG: --port="10250" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050955 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050958 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05917f91fe6fab2f6" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050966 2567 flags.go:64] FLAG: --qos-reserved="" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050969 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050972 2567 flags.go:64] FLAG: --register-node="true" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050975 2567 flags.go:64] FLAG: --register-with-taints="" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050979 2567 flags.go:64] FLAG: --registry-burst="10" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050982 2567 flags.go:64] FLAG: --registry-qps="5" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050985 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050988 2567 flags.go:64] FLAG: --reserved-memory="" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050993 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.050996 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051000 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051003 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051005 2567 flags.go:64] FLAG: --runonce="false" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051008 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051012 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051015 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051018 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 21:18:37.058781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051021 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051024 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051029 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051034 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051041 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051047 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051053 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051057 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051060 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051063 2567 flags.go:64] FLAG: --system-cgroups="" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051066 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051071 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051075 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051078 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051082 2567 flags.go:64] FLAG: --tls-min-version="" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051086 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051090 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051093 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051096 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051099 2567 flags.go:64] FLAG: --v="2" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051103 2567 flags.go:64] FLAG: --version="false" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051107 2567 flags.go:64] FLAG: --vmodule="" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051111 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.051116 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 21:18:37.059426 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051245 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051249 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051253 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051257 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051260 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051263 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051266 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051269 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051272 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051275 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051278 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051280 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051283 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051287 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051290 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051293 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051296 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051298 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051301 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051303 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:37.060284 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051306 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051309 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051312 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051315 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051318 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051320 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051323 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051325 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051328 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051330 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051333 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051337 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051339 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051342 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051345 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051348 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051351 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051353 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051362 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051365 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:37.061052 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051368 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051371 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051373 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051376 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051378 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051381 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051385 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051388 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051390 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051393 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051395 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051398 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051401 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051403 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051406 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051408 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051411 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051414 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051416 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051419 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:37.061561 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051422 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051424 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051427 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051431 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051433 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051436 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051438 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051441 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051444 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051447 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051449 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051452 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051454 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051457 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051459 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051462 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051465 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051468 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051472 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:37.062066 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051476 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051480 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051483 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051486 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051489 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051491 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051494 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051497 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051500 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051502 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051505 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051507 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051509 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051512 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051515 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051517 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051522 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051524 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051528 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:37.062599 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.051532 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.052273 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.058729 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.058746 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.058770 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.058776 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058835 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058840 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058844 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058848 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058851 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058854 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058856 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058864 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058868 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:37.063072 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058870 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058889 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058892 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058895 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058899 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058902 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058905 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058908 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058910 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058914 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058916 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058919 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058921 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058924 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058927 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058930 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058932 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058935 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058937 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058940 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:37.063463 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058943 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058946 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058949 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058952 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058956 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058960 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058963 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058966 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058969 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058971 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058974 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058979 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058981 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058984 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058987 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058989 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058992 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058994 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058997 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:37.064049 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.058999 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059002 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059005 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059007 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059010 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059013 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059015 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059018 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059020 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059023 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059026 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059029 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059031 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059034 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059037 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059040 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059042 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059045 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059048 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059050 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:37.064506 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059053 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059055 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059058 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059061 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059063 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059069 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059072 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059075 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059078 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059081 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059084 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059088 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059091 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059093 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059096 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059098 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059101 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059103 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059107 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:37.065015 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059110 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059113 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059116 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059119 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059122 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059124 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059128 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059131 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059134 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059137 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059139 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059142 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.059147 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059268 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059273 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:37.065467 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059276 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059280 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059283 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059285 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059289 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059291 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059294 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059298 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059302 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059305 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059308 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059311 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059314 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059317 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059319 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059322 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059325 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059327 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059330 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:37.065824 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059334 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059337 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059339 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059342 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059344 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059347 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059350 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059353 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059355 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059358 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059361 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059363 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059367 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059369 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059371 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059374 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059376 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059379 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059382 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059385 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:37.066327 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059387 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059389 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059392 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059394 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059397 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059399 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059401 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059404 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059406 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059409 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059412 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059414 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059417 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059419 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059421 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059424 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059426 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059429 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059432 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059435 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:37.066798 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059439 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059443 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059446 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059449 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059452 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059455 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059457 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059460 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059463 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059465 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059468 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059471 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059473 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059476 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059478 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059480 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059483 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059485 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059488 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059491 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:37.067304 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059493 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059495 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059498 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059500 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059503 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059505 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059508 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059510 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059513 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059516 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059518 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059521 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059523 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059526 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059528 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059531 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059533 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:37.067800 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:37.059536 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:37.068233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.059542 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:18:37.068233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.059652 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 21:18:37.068233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.063893 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 21:18:37.068233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.065105 2567 server.go:1019] "Starting client certificate rotation" Jun 05 21:18:37.068233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.065199 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:18:37.068233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.065237 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:18:37.068233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.067353 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:18:37.068504 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.068481 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:18:37.078440 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.078417 2567 log.go:25] "Validated CRI v1 runtime API" Jun 05 21:18:37.080697 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.080684 2567 log.go:25] "Validated CRI v1 image API" Jun 05 21:18:37.081574 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.081559 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 21:18:37.085120 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.085095 2567 fs.go:135] Filesystem UUIDs: map[0477f62b-19e3-42cf-aa3a-222888c8bba9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 be502045-1dd7-4be2-bba3-84b42fb36420:/dev/nvme0n1p3] Jun 05 21:18:37.085184 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.085121 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 21:18:37.089387 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.089283 2567 manager.go:216] Machine: {Timestamp:2026-06-05 21:18:37.088773646 +0000 UTC m=+0.325562862 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089618 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df51459d862589c662afd17a82586 SystemUUID:ec2df514-59d8-6258-9c66-2afd17a82586 BootID:01c2bbb5-18f6-4fed-b2c5-0de7dca86824 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:b8:89:72:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:b8:89:72:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:a1:cc:f5:87:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 21:18:37.089387 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.089383 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 21:18:37.089487 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.089457 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 21:18:37.092170 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.092145 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 21:18:37.092311 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.092176 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 21:18:37.092906 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.092897 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 21:18:37.092942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.092910 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 21:18:37.092942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.092917 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:18:37.093590 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.093580 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:18:37.094399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.094387 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 21:18:37.096370 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.096356 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:18:37.097280 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097269 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:18:37.097402 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097392 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 21:18:37.097431 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097425 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 05 21:18:37.097466 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097438 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 21:18:37.097466 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097461 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 21:18:37.097524 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097474 2567 kubelet.go:398] "Adding apiserver pod source" Jun 05 21:18:37.097524 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097487 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 21:18:37.097953 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097931 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:18:37.098031 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.097956 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:18:37.102912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.102895 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 21:18:37.104109 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.104095 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 21:18:37.104183 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.104124 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 21:18:37.105201 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105181 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 21:18:37.105241 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105204 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 21:18:37.105241 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105214 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 21:18:37.105241 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105223 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 21:18:37.105241 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105237 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 21:18:37.105351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105246 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 21:18:37.105351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105258 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 21:18:37.105351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105266 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 21:18:37.105351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105276 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 21:18:37.105351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105285 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 21:18:37.105351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105306 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 21:18:37.105351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105314 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 21:18:37.105996 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105985 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 21:18:37.106029 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.105997 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 21:18:37.107125 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.107095 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 21:18:37.107194 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.107124 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 21:18:37.107424 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.107409 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 21:18:37.109206 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.109192 2567 server.go:1268] "Started kubelet" Jun 05 21:18:37.109302 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.109257 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 21:18:37.109359 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.109267 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 21:18:37.109405 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.109388 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 21:18:37.110241 ip-10-0-136-105 systemd[1]: Started Kubernetes Kubelet. Jun 05 21:18:37.111175 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.111159 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 05 21:18:37.114233 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.114215 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 21:18:37.115152 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.114205 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-105.ec2.internal.18b64c0c00d93f70 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-105.ec2.internal,UID:ip-10-0-136-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-105.ec2.internal,},FirstTimestamp:2026-06-05 21:18:37.109165936 +0000 UTC m=+0.345955125,LastTimestamp:2026-06-05 21:18:37.109165936 +0000 UTC m=+0.345955125,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-105.ec2.internal,}" Jun 05 21:18:37.115238 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.115165 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5xnj" Jun 05 21:18:37.116080 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.116053 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 21:18:37.118986 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.118965 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 21:18:37.118986 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.118977 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 21:18:37.119136 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.119055 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.119529 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.119503 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 21:18:37.119611 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.119576 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 21:18:37.119611 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.119592 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 21:18:37.119720 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.119708 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 05 21:18:37.119720 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.119718 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 05 21:18:37.119899 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.119861 2567 factory.go:55] Registering systemd factory Jun 05 21:18:37.119899 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.119896 2567 factory.go:223] Registration of the systemd container factory successfully Jun 05 21:18:37.120125 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.120109 2567 factory.go:153] Registering CRI-O factory Jun 05 21:18:37.120125 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.120126 2567 factory.go:223] Registration of the crio container factory successfully Jun 05 21:18:37.120244 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.120173 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 21:18:37.120244 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.120197 2567 factory.go:103] Registering Raw factory Jun 05 21:18:37.120244 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.120213 2567 manager.go:1196] Started watching for new ooms in manager Jun 05 21:18:37.120661 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.120650 2567 manager.go:349] Starting recovery of all containers Jun 05 21:18:37.122718 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.122696 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5xnj" Jun 05 21:18:37.129440 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.129419 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:37.132774 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.132736 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-105.ec2.internal\" not found" node="ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.133168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.133155 2567 manager.go:354] Recovery completed Jun 05 21:18:37.137987 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.137975 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:37.139949 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.139929 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:37.140021 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.139970 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:37.140021 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.139986 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:37.140540 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.140524 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 21:18:37.140540 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.140539 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:37.140616 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.140540 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 21:18:37.140616 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.140561 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:18:37.141212 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.141196 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:37.141257 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.141230 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:37.141257 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.141245 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:37.141578 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.141567 2567 policy_none.go:49] "None policy: Start" Jun 05 21:18:37.141611 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.141582 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 21:18:37.141611 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.141592 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 21:18:37.142407 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.142397 2567 policy_none.go:47] "Start" Jun 05 21:18:37.183542 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.183523 2567 manager.go:337] "Starting Device Plugin manager" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.183558 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.183570 2567 server.go:87] "Starting device plugin registration server" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.183831 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.183844 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.183934 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.184026 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.184036 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.184475 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 21:18:37.189838 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.184526 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.190312 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.189870 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 21:18:37.191160 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.191139 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 21:18:37.191274 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.191177 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 21:18:37.191274 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.191197 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 21:18:37.191386 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.191283 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 21:18:37.193683 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.193662 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:37.284228 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.284202 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:37.285345 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.285330 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:37.285410 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.285361 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:37.285410 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.285370 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:37.285410 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.285392 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.292148 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.292093 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal"] Jun 05 21:18:37.292223 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.292159 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:37.292920 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.292903 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:37.293025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.292928 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:37.293025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.292940 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:37.293855 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.293838 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.293961 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.293863 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-105.ec2.internal\": node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.294143 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294132 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:37.294256 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.294301 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294269 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:37.294889 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294858 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:37.294998 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294894 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:37.294998 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294909 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:37.294998 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294970 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:37.294998 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.294998 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:37.295190 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.295010 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:37.296031 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.296015 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.296108 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.296045 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:37.296690 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.296676 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:37.296690 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.296699 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:37.296827 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.296709 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:37.311391 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.311374 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-105.ec2.internal\" not found" node="ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.314511 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.314493 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.315734 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.315722 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-105.ec2.internal\" not found" node="ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.415589 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.415559 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.421493 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.421472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3f9593240561cb8234518263a2c232a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal\" (UID: \"b3f9593240561cb8234518263a2c232a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.421551 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.421498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3f9593240561cb8234518263a2c232a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal\" (UID: \"b3f9593240561cb8234518263a2c232a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.421586 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.421567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c26ffe575f85643b72e1ed3f0552d5d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-105.ec2.internal\" (UID: \"1c26ffe575f85643b72e1ed3f0552d5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.515807 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.515777 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.522108 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.522091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3f9593240561cb8234518263a2c232a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal\" (UID: \"b3f9593240561cb8234518263a2c232a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.522171 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.522112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3f9593240561cb8234518263a2c232a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal\" (UID: \"b3f9593240561cb8234518263a2c232a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.522171 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.522133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c26ffe575f85643b72e1ed3f0552d5d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-105.ec2.internal\" (UID: \"1c26ffe575f85643b72e1ed3f0552d5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.522171 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.522160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c26ffe575f85643b72e1ed3f0552d5d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-105.ec2.internal\" (UID: \"1c26ffe575f85643b72e1ed3f0552d5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.522292 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.522178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3f9593240561cb8234518263a2c232a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal\" (UID: \"b3f9593240561cb8234518263a2c232a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.522292 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.522211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3f9593240561cb8234518263a2c232a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal\" (UID: \"b3f9593240561cb8234518263a2c232a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.614590 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.614523 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.616638 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.616623 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.619746 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:37.619733 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" Jun 05 21:18:37.717706 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.717664 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.818167 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.818140 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:37.918748 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:37.918668 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:38.019271 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:38.019106 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-105.ec2.internal\" not found" Jun 05 21:18:38.043421 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.043396 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:38.065024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.064998 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 21:18:38.065169 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.065151 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 21:18:38.065220 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.065185 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 21:18:38.065220 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.065185 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 21:18:38.100607 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.100586 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:38.103763 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:38.103736 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c26ffe575f85643b72e1ed3f0552d5d.slice/crio-19601fb9baca9b3bef42250a18e18542eeecb7da0297ad76d9224ea6da38ae84 WatchSource:0}: Error finding container 19601fb9baca9b3bef42250a18e18542eeecb7da0297ad76d9224ea6da38ae84: Status 404 returned error can't find the container with id 19601fb9baca9b3bef42250a18e18542eeecb7da0297ad76d9224ea6da38ae84 Jun 05 21:18:38.104150 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:38.104129 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f9593240561cb8234518263a2c232a.slice/crio-dbcc91acfd780ebcd8b4356726787b2bd6dc3955ec8938742c38c5a3f831c781 WatchSource:0}: Error finding container dbcc91acfd780ebcd8b4356726787b2bd6dc3955ec8938742c38c5a3f831c781: Status 404 returned error can't find the container with id dbcc91acfd780ebcd8b4356726787b2bd6dc3955ec8938742c38c5a3f831c781 Jun 05 21:18:38.109729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.109714 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:18:38.119527 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.119507 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" Jun 05 21:18:38.119612 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.119511 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 21:18:38.125844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.125810 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 21:13:37 +0000 UTC" deadline="2028-02-08 23:39:08.672544721 +0000 UTC" Jun 05 21:18:38.125844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.125844 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14714h20m30.546705099s" Jun 05 21:18:38.130232 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.130215 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:18:38.131255 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.131242 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" Jun 05 21:18:38.133931 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.133914 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:18:38.138843 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.138829 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:18:38.154263 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.154243 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxgtf" Jun 05 21:18:38.162126 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.162108 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxgtf" Jun 05 21:18:38.195850 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.195725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" event={"ID":"1c26ffe575f85643b72e1ed3f0552d5d","Type":"ContainerStarted","Data":"19601fb9baca9b3bef42250a18e18542eeecb7da0297ad76d9224ea6da38ae84"} Jun 05 21:18:38.196760 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.196737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" event={"ID":"b3f9593240561cb8234518263a2c232a","Type":"ContainerStarted","Data":"dbcc91acfd780ebcd8b4356726787b2bd6dc3955ec8938742c38c5a3f831c781"} Jun 05 21:18:38.873282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:38.873248 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:39.099094 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.099049 2567 apiserver.go:52] "Watching apiserver" Jun 05 21:18:39.105141 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.105116 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 21:18:39.105477 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.105452 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-gfn86","openshift-ovn-kubernetes/ovnkube-node-pphnl","kube-system/global-pull-secret-syncer-dltt6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq","openshift-cluster-node-tuning-operator/tuned-j7lxh","openshift-multus/multus-additional-cni-plugins-hcd9q","openshift-multus/network-metrics-daemon-fbkgz","openshift-network-operator/iptables-alerter-vztf8","kube-system/konnectivity-agent-xsrqw","kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal","openshift-dns/node-resolver-8zxjn","openshift-image-registry/node-ca-rd274","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal","openshift-multus/multus-q2h5v"] Jun 05 21:18:39.107495 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.107475 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:39.107609 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.107579 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:39.108837 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.108809 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.110469 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.110446 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.110569 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.110498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 21:18:39.110569 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.110516 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:39.110721 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.110705 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 21:18:39.110789 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.110747 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cz77x\"" Jun 05 21:18:39.112158 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.112134 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.113690 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.113676 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.114022 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.113984 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 21:18:39.114103 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.114032 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 21:18:39.114103 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.114040 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 21:18:39.114103 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.114058 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hszb9\"" Jun 05 21:18:39.115259 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.115231 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.115360 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.115333 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 21:18:39.115360 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.115350 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4q2ms\"" Jun 05 21:18:39.115522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.115504 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:18:39.117132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.116845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.117566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.117325 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 21:18:39.117566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.117353 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 21:18:39.117566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.117381 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 21:18:39.117566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.117382 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8w85t\"" Jun 05 21:18:39.117566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.117382 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 21:18:39.117566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.117325 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 21:18:39.118673 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.118577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.118756 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.118704 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ww6wc\"" Jun 05 21:18:39.119012 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.118961 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 21:18:39.119012 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.118982 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 21:18:39.120055 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.120036 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 21:18:39.120179 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.120159 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54vxd\"" Jun 05 21:18:39.120628 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.120608 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.122223 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.122208 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 21:18:39.122831 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.122694 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 21:18:39.122831 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.122726 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 21:18:39.122831 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.122749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.123220 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.123201 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 21:18:39.123220 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.123211 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 21:18:39.123380 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.123272 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 21:18:39.124029 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.124009 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcc9c\"" Jun 05 21:18:39.124432 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.124349 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 21:18:39.124432 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.124410 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dhxf9\"" Jun 05 21:18:39.124432 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.124415 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 21:18:39.124622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.124450 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:18:39.124745 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.124728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:39.124830 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.124790 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:39.128898 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.128234 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.129777 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.129756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzctq\" (UniqueName: \"kubernetes.io/projected/0a279011-45a7-449c-9754-a20d1c0d3f00-kube-api-access-tzctq\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:39.129887 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.129789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysctl-conf\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.129887 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.129812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-lib-modules\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.129887 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.129837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-var-lib-kubelet\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.130048 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.129903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a7dad4f-ea67-4fb0-bc36-d5186b5390cb-konnectivity-ca\") pod \"konnectivity-agent-xsrqw\" (UID: \"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb\") " pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.130048 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.129943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-kubelet\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.130048 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.129978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-run-netns\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.130048 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-ovn\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-kubernetes\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130076 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130081 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a7dad4f-ea67-4fb0-bc36-d5186b5390cb-agent-certs\") pod \"konnectivity-agent-xsrqw\" (UID: \"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb\") " pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-cni-netd\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130137 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130155 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b207abd-2216-45ce-84fe-1f49a8c0b49c-tmp-dir\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130180 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130235 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxggk\" (UniqueName: \"kubernetes.io/projected/f25d1d01-7c8a-4027-b3a9-f661cddcc337-kube-api-access-nxggk\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-host\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.130290 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-var-lib-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mg96\" (UniqueName: \"kubernetes.io/projected/46694f71-af83-46de-96b1-72be6e397441-kube-api-access-2mg96\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130323 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-system-cni-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovn-node-metrics-cert\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130390 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovnkube-script-lib\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130405 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bm8mm\"" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130426 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b207abd-2216-45ce-84fe-1f49a8c0b49c-hosts-file\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-device-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-etc-selinux\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-modprobe-d\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130556 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-cni-bin\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130608 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8dw\" (UniqueName: \"kubernetes.io/projected/8334fb72-c0ea-41d4-97ae-76ea20b86f73-kube-api-access-cf8dw\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysctl-d\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130692 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w598\" (UniqueName: \"kubernetes.io/projected/aebdbec4-c738-45d7-acaa-912a3901143f-kube-api-access-6w598\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.130728 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-systemd-units\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-node-log\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-system-cni-dir\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/417a4573-669e-4f5d-be23-34850c1f3f6a-dbus\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-systemd\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-socket-dir-parent\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130928 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-log-socket\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93658f8a-391e-436b-9a72-da92ddd67add-cni-binary-copy\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93658f8a-391e-436b-9a72-da92ddd67add-multus-daemon-config\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.130995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6tr8\" (UniqueName: \"kubernetes.io/projected/93658f8a-391e-436b-9a72-da92ddd67add-kube-api-access-d6tr8\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-systemd\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-cni-bin\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-env-overrides\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131088 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbhhl\" (UniqueName: \"kubernetes.io/projected/3b207abd-2216-45ce-84fe-1f49a8c0b49c-kube-api-access-wbhhl\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.131522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-sys-fs\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131144 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysconfig\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-cnibin\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-k8s-cni-cncf-io\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-kubelet\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aebdbec4-c738-45d7-acaa-912a3901143f-etc-tuned\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-cni-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131292 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-multus-certs\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-etc-kubernetes\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-os-release\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/417a4573-669e-4f5d-be23-34850c1f3f6a-kubelet-config\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-run\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aebdbec4-c738-45d7-acaa-912a3901143f-tmp\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-netns\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.132168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovnkube-config\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-registration-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cnibin\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-hostroot\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-socket-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-os-release\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-cni-multus\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131687 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-etc-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-run-ovn-kubernetes\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-conf-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-slash\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.132835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.131821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-sys\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.163085 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.163049 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:39.164610 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.164557 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:13:38 +0000 UTC" deadline="2027-12-04 21:34:14.554540672 +0000 UTC" Jun 05 21:18:39.164610 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.164609 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13128h15m35.389935163s" Jun 05 21:18:39.221445 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.221411 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 21:18:39.232037 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-os-release\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.232189 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/417a4573-669e-4f5d-be23-34850c1f3f6a-kubelet-config\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.232189 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-run\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.232189 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aebdbec4-c738-45d7-acaa-912a3901143f-tmp\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.232189 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/417a4573-669e-4f5d-be23-34850c1f3f6a-kubelet-config\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.232189 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232132 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm66f\" (UniqueName: \"kubernetes.io/projected/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-kube-api-access-dm66f\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232199 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-run\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-os-release\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-netns\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232258 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-netns\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232351 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovnkube-config\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-registration-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cnibin\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232404 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-hostroot\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.232450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-socket-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-hostroot\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-os-release\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232587 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cnibin\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232611 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-registration-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232590 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-cni-multus\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-os-release\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232648 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-etc-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232663 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-socket-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-run-ovn-kubernetes\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-conf-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232692 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-cni-multus\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-etc-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-slash\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232723 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-run-ovn-kubernetes\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.233024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-sys\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232743 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-conf-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-host\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232779 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-slash\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-host-slash\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzctq\" (UniqueName: \"kubernetes.io/projected/0a279011-45a7-449c-9754-a20d1c0d3f00-kube-api-access-tzctq\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-sys\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysctl-conf\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-lib-modules\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-var-lib-kubelet\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a7dad4f-ea67-4fb0-bc36-d5186b5390cb-konnectivity-ca\") pod \"konnectivity-agent-xsrqw\" (UID: \"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb\") " pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-iptables-alerter-script\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232975 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-lib-modules\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232985 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysctl-conf\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-kubelet\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.232967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovnkube-config\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233034 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-kubelet\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.233858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-run-netns\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233068 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-ovn\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233081 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-run-netns\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-kubernetes\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a7dad4f-ea67-4fb0-bc36-d5186b5390cb-agent-certs\") pod \"konnectivity-agent-xsrqw\" (UID: \"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb\") " pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-ovn\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-kubernetes\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-cni-netd\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b207abd-2216-45ce-84fe-1f49a8c0b49c-tmp-dir\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-var-lib-kubelet\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-cni-netd\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxggk\" (UniqueName: \"kubernetes.io/projected/f25d1d01-7c8a-4027-b3a9-f661cddcc337-kube-api-access-nxggk\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-host\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-var-lib-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mg96\" (UniqueName: \"kubernetes.io/projected/46694f71-af83-46de-96b1-72be6e397441-kube-api-access-2mg96\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-system-cni-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.234656 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233534 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b207abd-2216-45ce-84fe-1f49a8c0b49c-tmp-dir\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233541 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a7dad4f-ea67-4fb0-bc36-d5186b5390cb-konnectivity-ca\") pod \"konnectivity-agent-xsrqw\" (UID: \"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb\") " pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovn-node-metrics-cert\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233590 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-var-lib-openvswitch\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovnkube-script-lib\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b207abd-2216-45ce-84fe-1f49a8c0b49c-hosts-file\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-device-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-etc-selinux\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-modprobe-d\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-cni-bin\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8dw\" (UniqueName: \"kubernetes.io/projected/8334fb72-c0ea-41d4-97ae-76ea20b86f73-kube-api-access-cf8dw\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-device-dir\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysctl-d\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-host\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.235457 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-system-cni-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w598\" (UniqueName: \"kubernetes.io/projected/aebdbec4-c738-45d7-acaa-912a3901143f-kube-api-access-6w598\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233955 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-etc-selinux\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.233990 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-systemd-units\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-node-log\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b207abd-2216-45ce-84fe-1f49a8c0b49c-hosts-file\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234055 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-systemd-units\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234068 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-node-log\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-system-cni-dir\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234138 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-var-lib-cni-bin\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/417a4573-669e-4f5d-be23-34850c1f3f6a-dbus\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-systemd\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-socket-dir-parent\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-log-socket\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.236254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93658f8a-391e-436b-9a72-da92ddd67add-cni-binary-copy\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93658f8a-391e-436b-9a72-da92ddd67add-multus-daemon-config\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6tr8\" (UniqueName: \"kubernetes.io/projected/93658f8a-391e-436b-9a72-da92ddd67add-kube-api-access-d6tr8\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234473 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovnkube-script-lib\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-modprobe-d\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234645 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-system-cni-dir\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234673 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysctl-d\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234702 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/417a4573-669e-4f5d-be23-34850c1f3f6a-dbus\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f25d1d01-7c8a-4027-b3a9-f661cddcc337-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234749 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-socket-dir-parent\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-systemd\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234804 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-systemd\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234809 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-cni-bin\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f25d1d01-7c8a-4027-b3a9-f661cddcc337-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.234840 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-run-systemd\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234907 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-env-overrides\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.234927 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:39.734905113 +0000 UTC m=+2.971694292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234843 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-cni-bin\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234951 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-log-socket\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.234979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbhhl\" (UniqueName: \"kubernetes.io/projected/3b207abd-2216-45ce-84fe-1f49a8c0b49c-kube-api-access-wbhhl\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-sys-fs\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysconfig\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-cnibin\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-k8s-cni-cncf-io\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-kubelet\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.235187 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aebdbec4-c738-45d7-acaa-912a3901143f-etc-tuned\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-serviceca\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-cnibin\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93658f8a-391e-436b-9a72-da92ddd67add-cni-binary-copy\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.237934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9mq2\" (UniqueName: \"kubernetes.io/projected/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-kube-api-access-h9mq2\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.235392 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret podName:417a4573-669e-4f5d-be23-34850c1f3f6a nodeName:}" failed. No retries permitted until 2026-06-05 21:18:39.735374468 +0000 UTC m=+2.972163664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret") pod "global-pull-secret-syncer-dltt6" (UID: "417a4573-669e-4f5d-be23-34850c1f3f6a") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235400 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8334fb72-c0ea-41d4-97ae-76ea20b86f73-env-overrides\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aebdbec4-c738-45d7-acaa-912a3901143f-etc-sysconfig\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235468 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46694f71-af83-46de-96b1-72be6e397441-sys-fs\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93658f8a-391e-436b-9a72-da92ddd67add-multus-daemon-config\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235520 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8334fb72-c0ea-41d4-97ae-76ea20b86f73-host-kubelet\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-k8s-cni-cncf-io\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-cni-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-multus-certs\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235651 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-etc-kubernetes\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-multus-cni-dir\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-host-run-multus-certs\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.235799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93658f8a-391e-436b-9a72-da92ddd67add-etc-kubernetes\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.236695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aebdbec4-c738-45d7-acaa-912a3901143f-tmp\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.237639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8334fb72-c0ea-41d4-97ae-76ea20b86f73-ovn-node-metrics-cert\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.237741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aebdbec4-c738-45d7-acaa-912a3901143f-etc-tuned\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.238622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.238387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a7dad4f-ea67-4fb0-bc36-d5186b5390cb-agent-certs\") pod \"konnectivity-agent-xsrqw\" (UID: \"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb\") " pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.240324 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.240294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzctq\" (UniqueName: \"kubernetes.io/projected/0a279011-45a7-449c-9754-a20d1c0d3f00-kube-api-access-tzctq\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:39.241083 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.240917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxggk\" (UniqueName: \"kubernetes.io/projected/f25d1d01-7c8a-4027-b3a9-f661cddcc337-kube-api-access-nxggk\") pod \"multus-additional-cni-plugins-hcd9q\" (UID: \"f25d1d01-7c8a-4027-b3a9-f661cddcc337\") " pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.244208 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.241618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mg96\" (UniqueName: \"kubernetes.io/projected/46694f71-af83-46de-96b1-72be6e397441-kube-api-access-2mg96\") pod \"aws-ebs-csi-driver-node-jr8xq\" (UID: \"46694f71-af83-46de-96b1-72be6e397441\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.244208 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.241860 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w598\" (UniqueName: \"kubernetes.io/projected/aebdbec4-c738-45d7-acaa-912a3901143f-kube-api-access-6w598\") pod \"tuned-j7lxh\" (UID: \"aebdbec4-c738-45d7-acaa-912a3901143f\") " pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.244626 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.244604 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8dw\" (UniqueName: \"kubernetes.io/projected/8334fb72-c0ea-41d4-97ae-76ea20b86f73-kube-api-access-cf8dw\") pod \"ovnkube-node-pphnl\" (UID: \"8334fb72-c0ea-41d4-97ae-76ea20b86f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.245950 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.245927 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6tr8\" (UniqueName: \"kubernetes.io/projected/93658f8a-391e-436b-9a72-da92ddd67add-kube-api-access-d6tr8\") pod \"multus-q2h5v\" (UID: \"93658f8a-391e-436b-9a72-da92ddd67add\") " pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.247280 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.247256 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbhhl\" (UniqueName: \"kubernetes.io/projected/3b207abd-2216-45ce-84fe-1f49a8c0b49c-kube-api-access-wbhhl\") pod \"node-resolver-8zxjn\" (UID: \"3b207abd-2216-45ce-84fe-1f49a8c0b49c\") " pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.336496 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm66f\" (UniqueName: \"kubernetes.io/projected/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-kube-api-access-dm66f\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.336496 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-host\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.336727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-host-slash\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.336727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-iptables-alerter-script\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.336727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:39.336727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-host-slash\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.336727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-serviceca\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.336727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-host\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.336727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.336687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9mq2\" (UniqueName: \"kubernetes.io/projected/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-kube-api-access-h9mq2\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.337187 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.337159 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-iptables-alerter-script\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.337315 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.337218 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-serviceca\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.341890 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.341860 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:39.341982 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.341896 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:39.341982 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.341906 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzz5z for pod openshift-network-diagnostics/network-check-target-gfn86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:39.341982 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.341955 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z podName:4bdf7291-d626-4fb7-a6eb-29edb7b3f89e nodeName:}" failed. No retries permitted until 2026-06-05 21:18:39.841941538 +0000 UTC m=+3.078730714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dzz5z" (UniqueName: "kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z") pod "network-check-target-gfn86" (UID: "4bdf7291-d626-4fb7-a6eb-29edb7b3f89e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:39.344973 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.344954 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9mq2\" (UniqueName: \"kubernetes.io/projected/4b54dc5e-1eb8-49a7-8ba9-d19427c350ca-kube-api-access-h9mq2\") pod \"iptables-alerter-vztf8\" (UID: \"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca\") " pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.345066 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.344975 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm66f\" (UniqueName: \"kubernetes.io/projected/e35c1474-69c4-4617-aeba-eef3e7b9a3a9-kube-api-access-dm66f\") pod \"node-ca-rd274\" (UID: \"e35c1474-69c4-4617-aeba-eef3e7b9a3a9\") " pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.421782 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.421697 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8zxjn" Jun 05 21:18:39.428912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.428870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" Jun 05 21:18:39.438984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.438966 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" Jun 05 21:18:39.442655 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.442636 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" Jun 05 21:18:39.449400 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.449381 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:18:39.455998 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.455979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q2h5v" Jun 05 21:18:39.463939 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.463920 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:18:39.472677 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.472659 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vztf8" Jun 05 21:18:39.476910 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.476892 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rd274" Jun 05 21:18:39.739188 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.739095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:39.739188 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.739135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:39.739416 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.739264 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:39.739416 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.739322 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret podName:417a4573-669e-4f5d-be23-34850c1f3f6a nodeName:}" failed. No retries permitted until 2026-06-05 21:18:40.739307707 +0000 UTC m=+3.976096883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret") pod "global-pull-secret-syncer-dltt6" (UID: "417a4573-669e-4f5d-be23-34850c1f3f6a") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:39.739416 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.739265 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:39.739416 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.739406 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:40.739391805 +0000 UTC m=+3.976180985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:39.940008 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:39.939975 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:39.940152 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.940130 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:39.940152 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.940149 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:39.940237 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.940159 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzz5z for pod openshift-network-diagnostics/network-check-target-gfn86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:39.940237 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:39.940211 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z podName:4bdf7291-d626-4fb7-a6eb-29edb7b3f89e nodeName:}" failed. No retries permitted until 2026-06-05 21:18:40.940197968 +0000 UTC m=+4.176987144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzz5z" (UniqueName: "kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z") pod "network-check-target-gfn86" (UID: "4bdf7291-d626-4fb7-a6eb-29edb7b3f89e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:39.990428 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:39.990403 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7dad4f_ea67_4fb0_bc36_d5186b5390cb.slice/crio-89c6186d9b40982e523c7d0604d16865354dd48b0f89e77474fdd7d8afefbb98 WatchSource:0}: Error finding container 89c6186d9b40982e523c7d0604d16865354dd48b0f89e77474fdd7d8afefbb98: Status 404 returned error can't find the container with id 89c6186d9b40982e523c7d0604d16865354dd48b0f89e77474fdd7d8afefbb98 Jun 05 21:18:39.992410 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:39.992384 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25d1d01_7c8a_4027_b3a9_f661cddcc337.slice/crio-a6044ad4907e8b7c4cc78ed32faf0dc99aaeb1b230cb3ff93cbef22f8010a7ca WatchSource:0}: Error finding container a6044ad4907e8b7c4cc78ed32faf0dc99aaeb1b230cb3ff93cbef22f8010a7ca: Status 404 returned error can't find the container with id a6044ad4907e8b7c4cc78ed32faf0dc99aaeb1b230cb3ff93cbef22f8010a7ca Jun 05 21:18:39.993019 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:39.992997 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b54dc5e_1eb8_49a7_8ba9_d19427c350ca.slice/crio-b9b72e7544e80f6f7d9f277e4e45422eaf1d4365b502275abdfdfaa0b7251e36 WatchSource:0}: Error finding container b9b72e7544e80f6f7d9f277e4e45422eaf1d4365b502275abdfdfaa0b7251e36: Status 404 returned error can't find the container with id b9b72e7544e80f6f7d9f277e4e45422eaf1d4365b502275abdfdfaa0b7251e36 Jun 05 21:18:39.997237 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:39.997214 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8334fb72_c0ea_41d4_97ae_76ea20b86f73.slice/crio-d9da2fe57a7625dc6e33c7274d95dd6dc38b6ba8df7471782c1eb233cbe85e69 WatchSource:0}: Error finding container d9da2fe57a7625dc6e33c7274d95dd6dc38b6ba8df7471782c1eb233cbe85e69: Status 404 returned error can't find the container with id d9da2fe57a7625dc6e33c7274d95dd6dc38b6ba8df7471782c1eb233cbe85e69 Jun 05 21:18:39.998078 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:39.998057 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93658f8a_391e_436b_9a72_da92ddd67add.slice/crio-475abb7b7d402f71fc328c4bf969b0090e424fe7262620b2ffb189d658ebb3e2 WatchSource:0}: Error finding container 475abb7b7d402f71fc328c4bf969b0090e424fe7262620b2ffb189d658ebb3e2: Status 404 returned error can't find the container with id 475abb7b7d402f71fc328c4bf969b0090e424fe7262620b2ffb189d658ebb3e2 Jun 05 21:18:40.001044 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:40.000785 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b207abd_2216_45ce_84fe_1f49a8c0b49c.slice/crio-2f78e46cfc416541b40ca981de753fc4d87a1f622b543883f435a290edbdd207 WatchSource:0}: Error finding container 2f78e46cfc416541b40ca981de753fc4d87a1f622b543883f435a290edbdd207: Status 404 returned error can't find the container with id 2f78e46cfc416541b40ca981de753fc4d87a1f622b543883f435a290edbdd207 Jun 05 21:18:40.002582 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:40.002561 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46694f71_af83_46de_96b1_72be6e397441.slice/crio-e9d4ed5c80d2cea4b9b3a6844c0881587c60c7a2c9ae4349ccf91053aa0fa44b WatchSource:0}: Error finding container e9d4ed5c80d2cea4b9b3a6844c0881587c60c7a2c9ae4349ccf91053aa0fa44b: Status 404 returned error can't find the container with id e9d4ed5c80d2cea4b9b3a6844c0881587c60c7a2c9ae4349ccf91053aa0fa44b Jun 05 21:18:40.004007 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:40.003602 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebdbec4_c738_45d7_acaa_912a3901143f.slice/crio-42710065da8b4c6c285dba357add2af979af3e977b952eea717784c926b03cf0 WatchSource:0}: Error finding container 42710065da8b4c6c285dba357add2af979af3e977b952eea717784c926b03cf0: Status 404 returned error can't find the container with id 42710065da8b4c6c285dba357add2af979af3e977b952eea717784c926b03cf0 Jun 05 21:18:40.004971 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:18:40.004827 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35c1474_69c4_4617_aeba_eef3e7b9a3a9.slice/crio-50617ba1d93668310b5b705eda056985e29b16bc68395d3f8e71fe65e494b56c WatchSource:0}: Error finding container 50617ba1d93668310b5b705eda056985e29b16bc68395d3f8e71fe65e494b56c: Status 404 returned error can't find the container with id 50617ba1d93668310b5b705eda056985e29b16bc68395d3f8e71fe65e494b56c Jun 05 21:18:40.164746 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.164696 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:13:38 +0000 UTC" deadline="2028-01-30 06:00:01.05902289 +0000 UTC" Jun 05 21:18:40.164746 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.164740 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14480h41m20.894285467s" Jun 05 21:18:40.192148 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.192119 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:40.192283 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.192153 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:40.192283 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.192240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:40.192387 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.192357 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:40.205020 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.204991 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" event={"ID":"1c26ffe575f85643b72e1ed3f0552d5d","Type":"ContainerStarted","Data":"fc719a032302ddb6d270fc8f05dd0131bbbbe698961a12ac21084a685a3af171"} Jun 05 21:18:40.206139 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.206114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" event={"ID":"46694f71-af83-46de-96b1-72be6e397441","Type":"ContainerStarted","Data":"e9d4ed5c80d2cea4b9b3a6844c0881587c60c7a2c9ae4349ccf91053aa0fa44b"} Jun 05 21:18:40.207203 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.207175 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8zxjn" event={"ID":"3b207abd-2216-45ce-84fe-1f49a8c0b49c","Type":"ContainerStarted","Data":"2f78e46cfc416541b40ca981de753fc4d87a1f622b543883f435a290edbdd207"} Jun 05 21:18:40.208398 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.208374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q2h5v" event={"ID":"93658f8a-391e-436b-9a72-da92ddd67add","Type":"ContainerStarted","Data":"475abb7b7d402f71fc328c4bf969b0090e424fe7262620b2ffb189d658ebb3e2"} Jun 05 21:18:40.209321 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.209297 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vztf8" event={"ID":"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca","Type":"ContainerStarted","Data":"b9b72e7544e80f6f7d9f277e4e45422eaf1d4365b502275abdfdfaa0b7251e36"} Jun 05 21:18:40.210330 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.210311 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerStarted","Data":"a6044ad4907e8b7c4cc78ed32faf0dc99aaeb1b230cb3ff93cbef22f8010a7ca"} Jun 05 21:18:40.211326 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.211290 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xsrqw" event={"ID":"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb","Type":"ContainerStarted","Data":"89c6186d9b40982e523c7d0604d16865354dd48b0f89e77474fdd7d8afefbb98"} Jun 05 21:18:40.212351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.212332 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rd274" event={"ID":"e35c1474-69c4-4617-aeba-eef3e7b9a3a9","Type":"ContainerStarted","Data":"50617ba1d93668310b5b705eda056985e29b16bc68395d3f8e71fe65e494b56c"} Jun 05 21:18:40.213526 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.213503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" event={"ID":"aebdbec4-c738-45d7-acaa-912a3901143f","Type":"ContainerStarted","Data":"42710065da8b4c6c285dba357add2af979af3e977b952eea717784c926b03cf0"} Jun 05 21:18:40.214564 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.214547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"d9da2fe57a7625dc6e33c7274d95dd6dc38b6ba8df7471782c1eb233cbe85e69"} Jun 05 21:18:40.216910 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.216850 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-105.ec2.internal" podStartSLOduration=2.216836362 podStartE2EDuration="2.216836362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:40.216118223 +0000 UTC m=+3.452907411" watchObservedRunningTime="2026-06-05 21:18:40.216836362 +0000 UTC m=+3.453625561" Jun 05 21:18:40.686627 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.686330 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:40.745698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.745652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:40.745901 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.745720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:40.745974 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.745911 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:40.746026 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.745979 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret podName:417a4573-669e-4f5d-be23-34850c1f3f6a nodeName:}" failed. No retries permitted until 2026-06-05 21:18:42.745959742 +0000 UTC m=+5.982748921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret") pod "global-pull-secret-syncer-dltt6" (UID: "417a4573-669e-4f5d-be23-34850c1f3f6a") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:40.746416 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.746395 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:40.746500 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.746456 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:42.746437356 +0000 UTC m=+5.983226535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:40.947845 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:40.947752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:40.948033 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.947977 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:40.948033 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.947998 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:40.948033 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.948010 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzz5z for pod openshift-network-diagnostics/network-check-target-gfn86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:40.948201 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:40.948070 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z podName:4bdf7291-d626-4fb7-a6eb-29edb7b3f89e nodeName:}" failed. No retries permitted until 2026-06-05 21:18:42.948052479 +0000 UTC m=+6.184841672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzz5z" (UniqueName: "kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z") pod "network-check-target-gfn86" (UID: "4bdf7291-d626-4fb7-a6eb-29edb7b3f89e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:41.195087 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:41.194602 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:41.195087 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:41.194725 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:41.249340 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:41.249253 2567 generic.go:356] "Generic (PLEG): container finished" podID="b3f9593240561cb8234518263a2c232a" containerID="31cad6419567c326cd6df8f9a6bcdc0cd0b1a2dcd783ca75463f830106d79cd1" exitCode=0 Jun 05 21:18:41.249770 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:41.249744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" event={"ID":"b3f9593240561cb8234518263a2c232a","Type":"ContainerDied","Data":"31cad6419567c326cd6df8f9a6bcdc0cd0b1a2dcd783ca75463f830106d79cd1"} Jun 05 21:18:42.192166 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:42.191375 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:42.192166 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.191489 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:42.192166 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:42.191554 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:42.192166 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.191668 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:42.283619 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:42.283288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" event={"ID":"b3f9593240561cb8234518263a2c232a","Type":"ContainerStarted","Data":"80aef9521c7b8a306063a87e89e419e83d6dd0fac4e6f5e8bbdd444bc01d3962"} Jun 05 21:18:42.299710 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:42.299652 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-105.ec2.internal" podStartSLOduration=4.299633242 podStartE2EDuration="4.299633242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:42.298738868 +0000 UTC m=+5.535528068" watchObservedRunningTime="2026-06-05 21:18:42.299633242 +0000 UTC m=+5.536422442" Jun 05 21:18:42.760723 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:42.760654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:42.760917 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:42.760754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:42.760917 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.760870 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:42.761051 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.760962 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:46.760941945 +0000 UTC m=+9.997731124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:42.761360 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.761340 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:42.761449 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.761395 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret podName:417a4573-669e-4f5d-be23-34850c1f3f6a nodeName:}" failed. No retries permitted until 2026-06-05 21:18:46.761379968 +0000 UTC m=+9.998169144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret") pod "global-pull-secret-syncer-dltt6" (UID: "417a4573-669e-4f5d-be23-34850c1f3f6a") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:42.963963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:42.963303 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:42.963963 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.963509 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:42.963963 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.963529 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:42.963963 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.963542 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzz5z for pod openshift-network-diagnostics/network-check-target-gfn86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:42.963963 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:42.963603 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z podName:4bdf7291-d626-4fb7-a6eb-29edb7b3f89e nodeName:}" failed. No retries permitted until 2026-06-05 21:18:46.963583298 +0000 UTC m=+10.200372476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzz5z" (UniqueName: "kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z") pod "network-check-target-gfn86" (UID: "4bdf7291-d626-4fb7-a6eb-29edb7b3f89e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:43.192358 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:43.191792 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:43.192358 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:43.191950 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:44.191844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:44.191794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:44.192467 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:44.191936 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:44.192467 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:44.191805 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:44.192467 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:44.192128 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:45.192242 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:45.192211 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:45.192685 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:45.192340 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:46.192289 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:46.191613 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:46.192289 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.191742 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:46.192289 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:46.192146 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:46.192289 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.192252 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:46.796258 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:46.796215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:46.796449 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:46.796278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:46.796449 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.796385 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:46.796449 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.796410 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:46.796602 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.796466 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:54.796444344 +0000 UTC m=+18.033233542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:46.796602 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.796487 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret podName:417a4573-669e-4f5d-be23-34850c1f3f6a nodeName:}" failed. No retries permitted until 2026-06-05 21:18:54.796476621 +0000 UTC m=+18.033265798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret") pod "global-pull-secret-syncer-dltt6" (UID: "417a4573-669e-4f5d-be23-34850c1f3f6a") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:46.997654 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:46.997612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:46.997819 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.997791 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:46.997819 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.997812 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:46.997956 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.997825 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzz5z for pod openshift-network-diagnostics/network-check-target-gfn86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:46.997956 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:46.997903 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z podName:4bdf7291-d626-4fb7-a6eb-29edb7b3f89e nodeName:}" failed. No retries permitted until 2026-06-05 21:18:54.997864166 +0000 UTC m=+18.234653356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzz5z" (UniqueName: "kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z") pod "network-check-target-gfn86" (UID: "4bdf7291-d626-4fb7-a6eb-29edb7b3f89e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:47.192689 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:47.192610 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:47.193642 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:47.193259 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:48.192243 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:48.192205 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:48.192463 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:48.192355 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:48.192649 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:48.192624 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:48.192778 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:48.192756 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:49.192097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:49.192070 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:49.192268 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:49.192199 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:50.192058 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:50.192020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:50.192517 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:50.192185 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:50.192517 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:50.192202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:50.192517 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:50.192308 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:51.191955 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:51.191928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:51.192132 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:51.192026 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:52.191758 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:52.191723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:52.191949 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:52.191848 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:52.191949 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:52.191913 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:52.192075 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:52.192047 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:53.192045 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:53.192010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:53.192478 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:53.192140 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:54.192042 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:54.192010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:54.192522 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:54.192010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:54.192522 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:54.192131 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:54.192522 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:54.192188 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:54.854389 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:54.854344 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:54.854578 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:54.854431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:54.854578 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:54.854492 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:54.854578 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:54.854529 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:54.854578 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:54.854567 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret podName:417a4573-669e-4f5d-be23-34850c1f3f6a nodeName:}" failed. No retries permitted until 2026-06-05 21:19:10.854545837 +0000 UTC m=+34.091335017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret") pod "global-pull-secret-syncer-dltt6" (UID: "417a4573-669e-4f5d-be23-34850c1f3f6a") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:54.854766 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:54.854584 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:10.854577359 +0000 UTC m=+34.091366534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:55.055759 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:55.055720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:55.055938 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:55.055920 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:55.056007 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:55.055943 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:55.056007 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:55.055965 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzz5z for pod openshift-network-diagnostics/network-check-target-gfn86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:55.056097 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:55.056026 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z podName:4bdf7291-d626-4fb7-a6eb-29edb7b3f89e nodeName:}" failed. No retries permitted until 2026-06-05 21:19:11.05600773 +0000 UTC m=+34.292796911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzz5z" (UniqueName: "kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z") pod "network-check-target-gfn86" (UID: "4bdf7291-d626-4fb7-a6eb-29edb7b3f89e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:55.191870 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:55.191775 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:55.192050 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:55.191927 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:56.191942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:56.191910 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:56.192346 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:56.191944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:56.192346 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:56.192018 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:56.192346 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:56.192166 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:57.192546 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:57.192514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:57.193131 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:57.192640 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:58.192126 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:58.192087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:18:58.192126 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:58.192123 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:18:58.192443 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:58.192227 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:18:58.194786 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:58.192659 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:18:59.192352 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.192121 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:18:59.192488 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:18:59.192465 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:18:59.318335 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.318303 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" event={"ID":"46694f71-af83-46de-96b1-72be6e397441","Type":"ContainerStarted","Data":"68093b861d1f3d0715f94101b84438c3ede94a4222121199432f5746536e2877"} Jun 05 21:18:59.320095 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.320068 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8zxjn" event={"ID":"3b207abd-2216-45ce-84fe-1f49a8c0b49c","Type":"ContainerStarted","Data":"70fbd5b183a1c80503a717e4a39d086cf1757b605e962df7454110ffe5808e96"} Jun 05 21:18:59.321585 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.321560 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q2h5v" event={"ID":"93658f8a-391e-436b-9a72-da92ddd67add","Type":"ContainerStarted","Data":"c9c3414761153d97743c9039856c402ab691709ee7f482ba2d8cbcc55bbba194"} Jun 05 21:18:59.323008 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.322986 2567 generic.go:356] "Generic (PLEG): container finished" podID="f25d1d01-7c8a-4027-b3a9-f661cddcc337" containerID="206c3cc5f69d61e3dae4d109a5b27e249d2e01e091c038231ea3ef869b7c3d38" exitCode=0 Jun 05 21:18:59.323105 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.323049 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerDied","Data":"206c3cc5f69d61e3dae4d109a5b27e249d2e01e091c038231ea3ef869b7c3d38"} Jun 05 21:18:59.324507 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.324488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xsrqw" event={"ID":"7a7dad4f-ea67-4fb0-bc36-d5186b5390cb","Type":"ContainerStarted","Data":"12ea3e4e3ca907d8c4264523485a9ff269556f1138e0bccf6b8787b3cd4af0f2"} Jun 05 21:18:59.326138 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.326118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rd274" event={"ID":"e35c1474-69c4-4617-aeba-eef3e7b9a3a9","Type":"ContainerStarted","Data":"3d029c467992359a9c704aaf62f323ec7b04e3e246ab76e61f176b1b68fafab2"} Jun 05 21:18:59.327893 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.327854 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" event={"ID":"aebdbec4-c738-45d7-acaa-912a3901143f","Type":"ContainerStarted","Data":"852cfea225daa7523bc3e9461192839463bc7e78ef98928b9c170ba81c42e920"} Jun 05 21:18:59.329692 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.329672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"ff674d50bd2ccab9ef652f9861a7d70e077435b4d8c16dd842fe89b9574d75b6"} Jun 05 21:18:59.329806 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.329743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"472c43c2dca8b194fa9065cbe3e039b9c2247d610b5474c63387ffa478fec476"} Jun 05 21:18:59.329806 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.329795 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"8cba24cb0ce40037245313eb3e523d6d601815ac394b7bd08f53dc8fcab8a684"} Jun 05 21:18:59.334668 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.332802 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8zxjn" podStartSLOduration=3.457846443 podStartE2EDuration="22.332786023s" totalImagesPullingTime="18.87493958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:59.332054396 +0000 UTC m=+22.568843605" watchObservedRunningTime="2026-06-05 21:18:59.332786023 +0000 UTC m=+22.569575221" Jun 05 21:18:59.350190 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.350144 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q2h5v" podStartSLOduration=3.42338739 podStartE2EDuration="22.350125034s" totalImagesPullingTime="18.926737644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:59.349625765 +0000 UTC m=+22.586414976" watchObservedRunningTime="2026-06-05 21:18:59.350125034 +0000 UTC m=+22.586914232" Jun 05 21:18:59.386367 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.386318 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j7lxh" podStartSLOduration=3.509269899 podStartE2EDuration="22.386304494s" totalImagesPullingTime="18.877034595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:59.385949596 +0000 UTC m=+22.622738811" watchObservedRunningTime="2026-06-05 21:18:59.386304494 +0000 UTC m=+22.623093692" Jun 05 21:18:59.386631 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.386611 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rd274" podStartSLOduration=3.515713777 podStartE2EDuration="22.386606779s" totalImagesPullingTime="18.870893002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:59.368789437 +0000 UTC m=+22.605578635" watchObservedRunningTime="2026-06-05 21:18:59.386606779 +0000 UTC m=+22.623395974" Jun 05 21:18:59.426007 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:18:59.425965 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xsrqw" podStartSLOduration=8.213095557 podStartE2EDuration="22.425950973s" totalImagesPullingTime="14.212855416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:59.425793377 +0000 UTC m=+22.662582576" watchObservedRunningTime="2026-06-05 21:18:59.425950973 +0000 UTC m=+22.662740165" Jun 05 21:19:00.191455 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.191425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:00.191568 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:00.191549 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:19:00.191623 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.191576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:00.191711 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:00.191692 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:19:00.316946 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.316803 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 21:19:00.335764 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.335734 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"9821c9c09aa2920ae3e0ef76c7b8c83068e85bbac7d0b4b257da2a066d6d8649"} Jun 05 21:19:00.336438 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.335819 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"5db8b99640b0f33f6ee910f44f5f4826c1609d4352a3cf40675378a0a9be78df"} Jun 05 21:19:00.336438 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.335870 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"808d1116db03af1c1cbf340484a5f2fdd569d94812af3fc1cd25f367cab3dd59"} Jun 05 21:19:00.337699 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.337659 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" event={"ID":"46694f71-af83-46de-96b1-72be6e397441","Type":"ContainerStarted","Data":"7342e331d5984f2535b799d7af502206490857ac1e941d9c3dd0b3eaeaaf7ded"} Jun 05 21:19:00.339333 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.339299 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vztf8" event={"ID":"4b54dc5e-1eb8-49a7-8ba9-d19427c350ca","Type":"ContainerStarted","Data":"7c1a5b46ccea2fb186ad5b80bb6767add7224f58e436e645ff879787219b85ca"} Jun 05 21:19:00.356566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:00.356529 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vztf8" podStartSLOduration=4.472368615 podStartE2EDuration="23.356515596s" totalImagesPullingTime="18.884146981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:00.356266331 +0000 UTC m=+23.593055531" watchObservedRunningTime="2026-06-05 21:19:00.356515596 +0000 UTC m=+23.593304859" Jun 05 21:19:01.191868 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:01.191833 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:01.192167 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:01.191987 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:19:01.193570 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:01.193495 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T21:19:00.316819115Z","UUID":"cad91157-1c40-4802-ae54-b0bd4aac295f","Handler":null,"Name":"","Endpoint":""} Jun 05 21:19:01.195502 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:01.195469 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 21:19:01.195597 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:01.195508 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 21:19:01.769330 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:01.769301 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:19:01.769975 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:01.769951 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:19:02.191437 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:02.191405 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:02.191622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:02.191405 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:02.191622 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:02.191553 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:19:02.191735 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:02.191613 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:19:02.345891 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:02.345838 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" event={"ID":"46694f71-af83-46de-96b1-72be6e397441","Type":"ContainerStarted","Data":"395da87145e6546cf5c786cd7fe4c583e5e0e58965c97eeaed49d11e3c85689d"} Jun 05 21:19:02.349348 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:02.349319 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"99ea2cfa8f4e8250f094ba2dda10978102486f4892f7ffa6e4eab3b2cc3edebc"} Jun 05 21:19:02.362661 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:02.362619 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jr8xq" podStartSLOduration=4.39144207 podStartE2EDuration="25.362605527s" totalImagesPullingTime="20.971163457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:02.362208746 +0000 UTC m=+25.598997977" watchObservedRunningTime="2026-06-05 21:19:02.362605527 +0000 UTC m=+25.599394724" Jun 05 21:19:03.191820 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:03.191779 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:03.192417 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:03.191927 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:19:04.192678 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.192433 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:04.193131 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.192433 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:04.193131 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:04.192720 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:19:04.193131 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:04.192788 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:19:04.355318 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.355283 2567 generic.go:356] "Generic (PLEG): container finished" podID="f25d1d01-7c8a-4027-b3a9-f661cddcc337" containerID="cc0565d3ec6d13ae48fa54720090de8b6bd5026e9953221c3506bf7f4878c4c8" exitCode=0 Jun 05 21:19:04.355490 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.355370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerDied","Data":"cc0565d3ec6d13ae48fa54720090de8b6bd5026e9953221c3506bf7f4878c4c8"} Jun 05 21:19:04.359098 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.359077 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" event={"ID":"8334fb72-c0ea-41d4-97ae-76ea20b86f73","Type":"ContainerStarted","Data":"fe3e4587820d08f033a580adc657744ab178f05fc351d7f3a5d94de86b99a922"} Jun 05 21:19:04.359343 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.359321 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:19:04.359456 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.359390 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:19:04.374741 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.374716 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:19:04.374859 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.374828 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:19:04.396678 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:04.396635 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" podStartSLOduration=8.455074802 podStartE2EDuration="27.39661986s" totalImagesPullingTime="18.941545058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:04.396158579 +0000 UTC m=+27.632947823" watchObservedRunningTime="2026-06-05 21:19:04.39661986 +0000 UTC m=+27.633409057" Jun 05 21:19:05.191808 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.191771 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:05.192054 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:05.191915 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:19:05.361164 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.361137 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 21:19:05.780023 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.779767 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dltt6"] Jun 05 21:19:05.780363 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.780176 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:05.780363 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:05.780285 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:19:05.780577 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.780547 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbkgz"] Jun 05 21:19:05.780712 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.780665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:05.780800 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:05.780777 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:19:05.781153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.781130 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gfn86"] Jun 05 21:19:05.781316 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.781209 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:05.781316 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:05.781282 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:19:05.908622 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:05.908576 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:19:06.364569 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:06.364538 2567 generic.go:356] "Generic (PLEG): container finished" podID="f25d1d01-7c8a-4027-b3a9-f661cddcc337" containerID="e71df729d56ad47139466c5bee8ec3d53c771fe8a002fa0d0913a0e074126929" exitCode=0 Jun 05 21:19:06.365096 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:06.364631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerDied","Data":"e71df729d56ad47139466c5bee8ec3d53c771fe8a002fa0d0913a0e074126929"} Jun 05 21:19:07.192319 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:07.192293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:07.192319 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:07.192309 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:07.192543 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:07.192399 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:19:07.192589 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:07.192541 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:19:07.192589 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:07.192570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:07.192674 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:07.192656 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:19:08.372119 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:08.372084 2567 generic.go:356] "Generic (PLEG): container finished" podID="f25d1d01-7c8a-4027-b3a9-f661cddcc337" containerID="db33062cbe42ca7bd93d3634fce72ada73c8de11f0f34ce8b67f1c97dda7c269" exitCode=0 Jun 05 21:19:08.372626 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:08.372149 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerDied","Data":"db33062cbe42ca7bd93d3634fce72ada73c8de11f0f34ce8b67f1c97dda7c269"} Jun 05 21:19:08.608959 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:08.608921 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:19:08.609121 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:08.609053 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 21:19:08.609826 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:08.609802 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xsrqw" Jun 05 21:19:09.192326 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:09.192292 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:09.192510 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:09.192365 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:09.192510 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:09.192305 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:09.192510 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:09.192458 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:19:09.192694 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:09.192567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:19:09.192694 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:09.192646 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:19:10.877076 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:10.876860 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:10.877453 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:10.877091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:10.877453 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:10.877005 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:19:10.877453 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:10.877189 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:42.877175371 +0000 UTC m=+66.113964547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:19:10.877453 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:10.877207 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:19:10.877453 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:10.877259 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret podName:417a4573-669e-4f5d-be23-34850c1f3f6a nodeName:}" failed. No retries permitted until 2026-06-05 21:19:42.877245603 +0000 UTC m=+66.114034800 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret") pod "global-pull-secret-syncer-dltt6" (UID: "417a4573-669e-4f5d-be23-34850c1f3f6a") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:19:11.079024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.078987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:11.079194 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.079157 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:19:11.079194 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.079182 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:19:11.079194 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.079194 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzz5z for pod openshift-network-diagnostics/network-check-target-gfn86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:19:11.079340 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.079259 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z podName:4bdf7291-d626-4fb7-a6eb-29edb7b3f89e nodeName:}" failed. No retries permitted until 2026-06-05 21:19:43.079240777 +0000 UTC m=+66.316029953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzz5z" (UniqueName: "kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z") pod "network-check-target-gfn86" (UID: "4bdf7291-d626-4fb7-a6eb-29edb7b3f89e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:19:11.192395 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.192295 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:11.192395 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.192308 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:11.192626 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.192400 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gfn86" podUID="4bdf7291-d626-4fb7-a6eb-29edb7b3f89e" Jun 05 21:19:11.192626 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.192493 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:19:11.192626 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.192311 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:11.192626 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.192586 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dltt6" podUID="417a4573-669e-4f5d-be23-34850c1f3f6a" Jun 05 21:19:11.612022 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.611989 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-105.ec2.internal" event="NodeReady" Jun 05 21:19:11.612197 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.612183 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 21:19:11.654180 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.654099 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dlh9x"] Jun 05 21:19:11.656678 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.656656 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ghwzl"] Jun 05 21:19:11.656811 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.656791 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.658257 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.658239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:11.659204 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.659181 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6hvj9\"" Jun 05 21:19:11.659333 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.659215 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 21:19:11.659333 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.659236 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 21:19:11.659990 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.659972 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 21:19:11.660253 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.660234 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 21:19:11.660336 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.660285 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2p6vl\"" Jun 05 21:19:11.660478 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.660459 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 21:19:11.663748 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.663698 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghwzl"] Jun 05 21:19:11.667435 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.667417 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dlh9x"] Jun 05 21:19:11.783794 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.783761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51b1c7e8-5203-44d8-855c-59832720b4dd-config-volume\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.783984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.783802 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b1c7e8-5203-44d8-855c-59832720b4dd-tmp-dir\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.783984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.783829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.783984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.783898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcsj\" (UniqueName: \"kubernetes.io/projected/51b1c7e8-5203-44d8-855c-59832720b4dd-kube-api-access-wpcsj\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.784151 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.784033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77hdp\" (UniqueName: \"kubernetes.io/projected/b9f552dd-786d-49ac-b51b-5987fc28c830-kube-api-access-77hdp\") pod \"ingress-canary-ghwzl\" (UID: \"b9f552dd-786d-49ac-b51b-5987fc28c830\") " pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:11.784151 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.784087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9f552dd-786d-49ac-b51b-5987fc28c830-cert\") pod \"ingress-canary-ghwzl\" (UID: \"b9f552dd-786d-49ac-b51b-5987fc28c830\") " pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:11.885215 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51b1c7e8-5203-44d8-855c-59832720b4dd-config-volume\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.885215 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b1c7e8-5203-44d8-855c-59832720b4dd-tmp-dir\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.885667 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.885667 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcsj\" (UniqueName: \"kubernetes.io/projected/51b1c7e8-5203-44d8-855c-59832720b4dd-kube-api-access-wpcsj\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.885667 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77hdp\" (UniqueName: \"kubernetes.io/projected/b9f552dd-786d-49ac-b51b-5987fc28c830-kube-api-access-77hdp\") pod \"ingress-canary-ghwzl\" (UID: \"b9f552dd-786d-49ac-b51b-5987fc28c830\") " pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:11.885667 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9f552dd-786d-49ac-b51b-5987fc28c830-cert\") pod \"ingress-canary-ghwzl\" (UID: \"b9f552dd-786d-49ac-b51b-5987fc28c830\") " pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:11.885667 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.885380 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:11.885667 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:11.885455 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:19:12.385432853 +0000 UTC m=+35.622222031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:19:11.885667 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885587 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b1c7e8-5203-44d8-855c-59832720b4dd-tmp-dir\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.886148 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.885778 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51b1c7e8-5203-44d8-855c-59832720b4dd-config-volume\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.889966 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.889941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9f552dd-786d-49ac-b51b-5987fc28c830-cert\") pod \"ingress-canary-ghwzl\" (UID: \"b9f552dd-786d-49ac-b51b-5987fc28c830\") " pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:11.895892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.895856 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77hdp\" (UniqueName: \"kubernetes.io/projected/b9f552dd-786d-49ac-b51b-5987fc28c830-kube-api-access-77hdp\") pod \"ingress-canary-ghwzl\" (UID: \"b9f552dd-786d-49ac-b51b-5987fc28c830\") " pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:11.896006 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.895932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcsj\" (UniqueName: \"kubernetes.io/projected/51b1c7e8-5203-44d8-855c-59832720b4dd-kube-api-access-wpcsj\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:11.976068 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:11.976036 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ghwzl" Jun 05 21:19:12.388825 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:12.388796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:12.389030 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:12.388968 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:12.389093 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:12.389040 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:19:13.389019592 +0000 UTC m=+36.625808788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:19:12.822363 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:12.822335 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ghwzl"] Jun 05 21:19:12.826835 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:19:12.826774 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f552dd_786d_49ac_b51b_5987fc28c830.slice/crio-cc41562eb73ae685ce72f91b351ac85b45af0b425ebc4a906b1b25ef436bf479 WatchSource:0}: Error finding container cc41562eb73ae685ce72f91b351ac85b45af0b425ebc4a906b1b25ef436bf479: Status 404 returned error can't find the container with id cc41562eb73ae685ce72f91b351ac85b45af0b425ebc4a906b1b25ef436bf479 Jun 05 21:19:13.191597 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.191421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:13.192101 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.191420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:13.192101 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.191421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:13.193913 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.193894 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:19:13.194796 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.194776 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:19:13.194796 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.194788 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrpm8\"" Jun 05 21:19:13.194965 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.194788 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6kmjr\"" Jun 05 21:19:13.194965 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.194792 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:19:13.194965 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.194791 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:19:13.386482 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.386443 2567 generic.go:356] "Generic (PLEG): container finished" podID="f25d1d01-7c8a-4027-b3a9-f661cddcc337" containerID="75ddc91c530b59e54e16905a463cf5a8cbe2b86b7e0e566c6c1448d6474147f4" exitCode=0 Jun 05 21:19:13.386658 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.386545 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerDied","Data":"75ddc91c530b59e54e16905a463cf5a8cbe2b86b7e0e566c6c1448d6474147f4"} Jun 05 21:19:13.387852 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.387828 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghwzl" event={"ID":"b9f552dd-786d-49ac-b51b-5987fc28c830","Type":"ContainerStarted","Data":"cc41562eb73ae685ce72f91b351ac85b45af0b425ebc4a906b1b25ef436bf479"} Jun 05 21:19:13.397553 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:13.397528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:13.397702 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:13.397687 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:13.397763 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:13.397751 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:19:15.397732236 +0000 UTC m=+38.634521421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:19:14.394299 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:14.394270 2567 generic.go:356] "Generic (PLEG): container finished" podID="f25d1d01-7c8a-4027-b3a9-f661cddcc337" containerID="ee7722c5019715a4aec22eac67f5eb443b4af9746762c61f20e569ad19ff126b" exitCode=0 Jun 05 21:19:14.394736 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:14.394346 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerDied","Data":"ee7722c5019715a4aec22eac67f5eb443b4af9746762c61f20e569ad19ff126b"} Jun 05 21:19:15.399926 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:15.399893 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" event={"ID":"f25d1d01-7c8a-4027-b3a9-f661cddcc337","Type":"ContainerStarted","Data":"5ffd64b9ee96df8783bf3e50eb2966efe8cbce9f3a61843498f9fca3180a81c0"} Jun 05 21:19:15.401166 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:15.401142 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ghwzl" event={"ID":"b9f552dd-786d-49ac-b51b-5987fc28c830","Type":"ContainerStarted","Data":"c9aa5b4c898213126fbfebb15ccb23b93e36dc1f13f4ddc34502ec5a957993bc"} Jun 05 21:19:15.413924 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:15.413895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:15.414065 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:15.414015 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:15.414065 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:15.414064 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:19:19.414051625 +0000 UTC m=+42.650840802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:19:15.419917 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:15.419861 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hcd9q" podStartSLOduration=8.860948826 podStartE2EDuration="38.419847314s" totalImagesPullingTime="29.558898488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:15.418832974 +0000 UTC m=+38.655622175" watchObservedRunningTime="2026-06-05 21:19:15.419847314 +0000 UTC m=+38.656636519" Jun 05 21:19:15.433838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:15.433790 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ghwzl" podStartSLOduration=2.905588622 podStartE2EDuration="4.433772426s" totalImagesPullingTime="1.528183804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:15.433094223 +0000 UTC m=+38.669883423" watchObservedRunningTime="2026-06-05 21:19:15.433772426 +0000 UTC m=+38.670561639" Jun 05 21:19:19.442754 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:19.442712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:19.443164 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:19.442855 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:19.443164 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:19.442936 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:19:27.44292003 +0000 UTC m=+50.679709206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:19:27.496217 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:27.496180 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:27.496778 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:27.496344 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:27.496778 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:27.496430 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:19:43.496406727 +0000 UTC m=+66.733195909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:19:37.387758 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:37.387723 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pphnl" Jun 05 21:19:42.892654 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:42.892602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:19:42.892654 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:42.892657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:42.895144 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:42.895124 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:19:42.895251 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:42.895176 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:19:42.902868 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:42.902848 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:19:42.902965 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:42.902929 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:20:46.902910618 +0000 UTC m=+130.139699805 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : secret "metrics-daemon-secret" not found Jun 05 21:19:42.906063 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:42.906042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/417a4573-669e-4f5d-be23-34850c1f3f6a-original-pull-secret\") pod \"global-pull-secret-syncer-dltt6\" (UID: \"417a4573-669e-4f5d-be23-34850c1f3f6a\") " pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:42.908981 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:42.908951 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dltt6" Jun 05 21:19:43.024926 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.024891 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dltt6"] Jun 05 21:19:43.028567 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:19:43.028542 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417a4573_669e_4f5d_be23_34850c1f3f6a.slice/crio-4f4c3745846ccade7f9bbd581366e9e9bf80bed1381adb7c0a986d727bc39f94 WatchSource:0}: Error finding container 4f4c3745846ccade7f9bbd581366e9e9bf80bed1381adb7c0a986d727bc39f94: Status 404 returned error can't find the container with id 4f4c3745846ccade7f9bbd581366e9e9bf80bed1381adb7c0a986d727bc39f94 Jun 05 21:19:43.094336 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.094300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:43.096807 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.096783 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:19:43.106539 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.106518 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:19:43.117403 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.117379 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzz5z\" (UniqueName: \"kubernetes.io/projected/4bdf7291-d626-4fb7-a6eb-29edb7b3f89e-kube-api-access-dzz5z\") pod \"network-check-target-gfn86\" (UID: \"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e\") " pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:43.217556 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.217479 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrpm8\"" Jun 05 21:19:43.225593 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.225572 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:43.350713 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.350682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gfn86"] Jun 05 21:19:43.354326 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:19:43.354296 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdf7291_d626_4fb7_a6eb_29edb7b3f89e.slice/crio-8bbab989a782ed24640d344d8bd84d1133dbb84eec7056f3c30affa5600ce866 WatchSource:0}: Error finding container 8bbab989a782ed24640d344d8bd84d1133dbb84eec7056f3c30affa5600ce866: Status 404 returned error can't find the container with id 8bbab989a782ed24640d344d8bd84d1133dbb84eec7056f3c30affa5600ce866 Jun 05 21:19:43.467167 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.467129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dltt6" event={"ID":"417a4573-669e-4f5d-be23-34850c1f3f6a","Type":"ContainerStarted","Data":"4f4c3745846ccade7f9bbd581366e9e9bf80bed1381adb7c0a986d727bc39f94"} Jun 05 21:19:43.468214 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.468158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gfn86" event={"ID":"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e","Type":"ContainerStarted","Data":"8bbab989a782ed24640d344d8bd84d1133dbb84eec7056f3c30affa5600ce866"} Jun 05 21:19:43.496671 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.496640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:19:43.496772 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:43.496760 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:43.496819 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:19:43.496811 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:20:15.496798223 +0000 UTC m=+98.733587399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:19:43.610847 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.610811 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf"] Jun 05 21:19:43.629579 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.629551 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf"] Jun 05 21:19:43.629744 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.629660 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.631807 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.631781 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 21:19:43.631952 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.631914 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 21:19:43.632241 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.632223 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 21:19:43.632497 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.632474 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 21:19:43.699005 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.698974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/76f64827-e555-406a-a0f0-958b3a30b0b8-klusterlet-config\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.699174 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.699048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76f64827-e555-406a-a0f0-958b3a30b0b8-tmp\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.699174 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.699084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqp5\" (UniqueName: \"kubernetes.io/projected/76f64827-e555-406a-a0f0-958b3a30b0b8-kube-api-access-zkqp5\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.800496 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.799683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/76f64827-e555-406a-a0f0-958b3a30b0b8-klusterlet-config\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.800496 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.799766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76f64827-e555-406a-a0f0-958b3a30b0b8-tmp\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.800496 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.799807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqp5\" (UniqueName: \"kubernetes.io/projected/76f64827-e555-406a-a0f0-958b3a30b0b8-kube-api-access-zkqp5\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.800496 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.800450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76f64827-e555-406a-a0f0-958b3a30b0b8-tmp\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.803064 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.803018 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/76f64827-e555-406a-a0f0-958b3a30b0b8-klusterlet-config\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.807463 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.807426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqp5\" (UniqueName: \"kubernetes.io/projected/76f64827-e555-406a-a0f0-958b3a30b0b8-kube-api-access-zkqp5\") pod \"klusterlet-addon-workmgr-79f89dbc5f-mbtpf\" (UID: \"76f64827-e555-406a-a0f0-958b3a30b0b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:43.941821 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:43.941784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:44.108670 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:44.108561 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf"] Jun 05 21:19:44.112639 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:19:44.112607 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f64827_e555_406a_a0f0_958b3a30b0b8.slice/crio-8d1742b98efe5edd066ed23723d8c5eeef6e414f7d002aa938fccc1532928b97 WatchSource:0}: Error finding container 8d1742b98efe5edd066ed23723d8c5eeef6e414f7d002aa938fccc1532928b97: Status 404 returned error can't find the container with id 8d1742b98efe5edd066ed23723d8c5eeef6e414f7d002aa938fccc1532928b97 Jun 05 21:19:44.473618 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:44.473495 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" event={"ID":"76f64827-e555-406a-a0f0-958b3a30b0b8","Type":"ContainerStarted","Data":"8d1742b98efe5edd066ed23723d8c5eeef6e414f7d002aa938fccc1532928b97"} Jun 05 21:19:50.491425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.491383 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dltt6" event={"ID":"417a4573-669e-4f5d-be23-34850c1f3f6a","Type":"ContainerStarted","Data":"36d9b3fe7cd1abf58cde799e4983318d87ae3232725a1fb7610d4bc3b4924a8e"} Jun 05 21:19:50.492777 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.492746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" event={"ID":"76f64827-e555-406a-a0f0-958b3a30b0b8","Type":"ContainerStarted","Data":"8d95a46d1a44d381934022f0621abf4d3c2dcecbff3faef3225445d27b1725f9"} Jun 05 21:19:50.492950 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.492920 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:50.494113 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.494089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gfn86" event={"ID":"4bdf7291-d626-4fb7-a6eb-29edb7b3f89e","Type":"ContainerStarted","Data":"a4e08d6c2859cfaff27442b1776e1ba49ece73a78755be65715548dabf36f1ae"} Jun 05 21:19:50.494253 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.494226 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:19:50.494758 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.494739 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:19:50.504785 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.504745 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dltt6" podStartSLOduration=66.57656511 podStartE2EDuration="1m13.504733893s" totalImagesPullingTime="6.928168783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:50.504186004 +0000 UTC m=+73.740975202" watchObservedRunningTime="2026-06-05 21:19:50.504733893 +0000 UTC m=+73.741523113" Jun 05 21:19:50.517351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.517317 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gfn86" podStartSLOduration=66.928378762 podStartE2EDuration="1m13.517307654s" totalImagesPullingTime="6.588928892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:50.516767236 +0000 UTC m=+73.753556452" watchObservedRunningTime="2026-06-05 21:19:50.517307654 +0000 UTC m=+73.754096855" Jun 05 21:19:50.530416 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:19:50.530373 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" podStartSLOduration=1.633320528 podStartE2EDuration="7.530363776s" totalImagesPullingTime="5.897043248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:50.52974566 +0000 UTC m=+73.766534858" watchObservedRunningTime="2026-06-05 21:19:50.530363776 +0000 UTC m=+73.767152973" Jun 05 21:20:15.525893 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:20:15.525839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:20:15.526290 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:20:15.525994 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:20:15.526290 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:20:15.526068 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:21:19.526051618 +0000 UTC m=+162.762840798 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:20:21.499299 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:20:21.499270 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gfn86" Jun 05 21:20:46.936595 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:20:46.936549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:20:46.937144 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:20:46.936703 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:20:46.937144 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:20:46.936794 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs podName:0a279011-45a7-449c-9754-a20d1c0d3f00 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:48.936778458 +0000 UTC m=+252.173567637 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs") pod "network-metrics-daemon-fbkgz" (UID: "0a279011-45a7-449c-9754-a20d1c0d3f00") : secret "metrics-daemon-secret" not found Jun 05 21:21:14.670198 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:14.670147 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dlh9x" podUID="51b1c7e8-5203-44d8-855c-59832720b4dd" Jun 05 21:21:14.695015 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:14.694993 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlh9x" Jun 05 21:21:16.202255 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:16.202200 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fbkgz" podUID="0a279011-45a7-449c-9754-a20d1c0d3f00" Jun 05 21:21:19.558159 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:19.558102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:21:19.558566 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:19.558259 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:21:19.558566 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:19.558326 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls podName:51b1c7e8-5203-44d8-855c-59832720b4dd nodeName:}" failed. No retries permitted until 2026-06-05 21:23:21.558309864 +0000 UTC m=+284.795099040 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls") pod "dns-default-dlh9x" (UID: "51b1c7e8-5203-44d8-855c-59832720b4dd") : secret "dns-default-metrics-tls" not found Jun 05 21:21:31.194616 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:31.194548 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:21:50.493708 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:50.493610 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" podUID="76f64827-e555-406a-a0f0-958b3a30b0b8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 05 21:21:50.784691 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:50.784660 2567 generic.go:356] "Generic (PLEG): container finished" podID="76f64827-e555-406a-a0f0-958b3a30b0b8" containerID="8d95a46d1a44d381934022f0621abf4d3c2dcecbff3faef3225445d27b1725f9" exitCode=1 Jun 05 21:21:50.784846 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:50.784709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" event={"ID":"76f64827-e555-406a-a0f0-958b3a30b0b8","Type":"ContainerDied","Data":"8d95a46d1a44d381934022f0621abf4d3c2dcecbff3faef3225445d27b1725f9"} Jun 05 21:21:50.785032 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:50.785020 2567 scope.go:117] "RemoveContainer" containerID="8d95a46d1a44d381934022f0621abf4d3c2dcecbff3faef3225445d27b1725f9" Jun 05 21:21:51.788477 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:51.788446 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" event={"ID":"76f64827-e555-406a-a0f0-958b3a30b0b8","Type":"ContainerStarted","Data":"35ae99ef49de04d765439c693c40aab39e34312dd4cb74b38cb9d9b3c7f44f37"} Jun 05 21:21:51.788855 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:51.788713 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:21:51.789286 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:51.789267 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79f89dbc5f-mbtpf" Jun 05 21:21:52.553346 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.553307 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72"] Jun 05 21:21:52.555227 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.555189 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6744f8c88d-cmpzq"] Jun 05 21:21:52.555334 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.555320 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.556768 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.556752 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.559112 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.559092 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 21:21:52.559285 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.559269 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.559512 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.559496 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.560050 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.560027 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 21:21:52.560050 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.560043 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 21:21:52.560186 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.560051 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k5klj\"" Jun 05 21:21:52.560186 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.560152 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ph72b\"" Jun 05 21:21:52.560272 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.560186 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 21:21:52.560339 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.560323 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 21:21:52.565670 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.565652 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 21:21:52.568582 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.568563 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72"] Jun 05 21:21:52.574207 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.574189 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6744f8c88d-cmpzq"] Jun 05 21:21:52.648344 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.648313 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-7vnfn"] Jun 05 21:21:52.650211 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.650194 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.652584 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.652556 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 21:21:52.652940 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.652924 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.652995 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.652932 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-c249j\"" Jun 05 21:21:52.652995 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.652990 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.653436 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.653418 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 21:21:52.661070 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.661049 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 21:21:52.662567 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.662547 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-7vnfn"] Jun 05 21:21:52.673097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673192 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-certificates\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673192 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-trusted-ca\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673192 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-installation-pull-secrets\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673192 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-image-registry-private-configuration\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673192 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l9nw\" (UniqueName: \"kubernetes.io/projected/dbfc8003-7513-4157-9e67-1954dd63fec2-kube-api-access-9l9nw\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.673354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbfc8003-7513-4157-9e67-1954dd63fec2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.673354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.673354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e44f786a-5e1e-44c5-b17f-8238f24bd589-config\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.673354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e44f786a-5e1e-44c5-b17f-8238f24bd589-serving-cert\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.673354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-ca-trust-extracted\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-bound-sa-token\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673539 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twc5x\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-kube-api-access-twc5x\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.673539 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e44f786a-5e1e-44c5-b17f-8238f24bd589-trusted-ca\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.673539 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.673450 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzjcv\" (UniqueName: \"kubernetes.io/projected/e44f786a-5e1e-44c5-b17f-8238f24bd589-kube-api-access-bzjcv\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.774471 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774437 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l9nw\" (UniqueName: \"kubernetes.io/projected/dbfc8003-7513-4157-9e67-1954dd63fec2-kube-api-access-9l9nw\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.774471 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbfc8003-7513-4157-9e67-1954dd63fec2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.774710 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.774710 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e44f786a-5e1e-44c5-b17f-8238f24bd589-config\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.774710 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:52.774616 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:52.774710 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:52.774681 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls podName:dbfc8003-7513-4157-9e67-1954dd63fec2 nodeName:}" failed. No retries permitted until 2026-06-05 21:21:53.27466152 +0000 UTC m=+196.511450702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xdf72" (UID: "dbfc8003-7513-4157-9e67-1954dd63fec2") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:52.774963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e44f786a-5e1e-44c5-b17f-8238f24bd589-serving-cert\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.774963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-ca-trust-extracted\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.774963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-bound-sa-token\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.774963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twc5x\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-kube-api-access-twc5x\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.774963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e44f786a-5e1e-44c5-b17f-8238f24bd589-trusted-ca\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.775271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.774981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzjcv\" (UniqueName: \"kubernetes.io/projected/e44f786a-5e1e-44c5-b17f-8238f24bd589-kube-api-access-bzjcv\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.775271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775013 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.775271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-certificates\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.775271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-trusted-ca\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.775271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-installation-pull-secrets\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.775271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-image-registry-private-configuration\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.775271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-ca-trust-extracted\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.775607 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e44f786a-5e1e-44c5-b17f-8238f24bd589-config\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.775607 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:52.775402 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:21:52.775607 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:52.775417 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6744f8c88d-cmpzq: secret "image-registry-tls" not found Jun 05 21:21:52.775607 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775447 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dbfc8003-7513-4157-9e67-1954dd63fec2-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.775607 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:52.775475 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls podName:764d6a11-a12f-4d21-a9d0-c69fbb603c3a nodeName:}" failed. No retries permitted until 2026-06-05 21:21:53.275458524 +0000 UTC m=+196.512247701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls") pod "image-registry-6744f8c88d-cmpzq" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a") : secret "image-registry-tls" not found Jun 05 21:21:52.775866 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775763 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-certificates\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.776005 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.775984 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e44f786a-5e1e-44c5-b17f-8238f24bd589-trusted-ca\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.776193 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.776173 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-trusted-ca\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.777748 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.777724 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e44f786a-5e1e-44c5-b17f-8238f24bd589-serving-cert\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.777837 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.777760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-image-registry-private-configuration\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.777837 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.777769 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-installation-pull-secrets\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.788334 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.788310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l9nw\" (UniqueName: \"kubernetes.io/projected/dbfc8003-7513-4157-9e67-1954dd63fec2-kube-api-access-9l9nw\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:52.788420 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.788336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzjcv\" (UniqueName: \"kubernetes.io/projected/e44f786a-5e1e-44c5-b17f-8238f24bd589-kube-api-access-bzjcv\") pod \"console-operator-668fdbf85c-7vnfn\" (UID: \"e44f786a-5e1e-44c5-b17f-8238f24bd589\") " pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:52.788462 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.788448 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-bound-sa-token\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.788594 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.788579 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twc5x\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-kube-api-access-twc5x\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:52.962758 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:52.962665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:21:53.078423 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:53.078388 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-7vnfn"] Jun 05 21:21:53.081588 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:21:53.081565 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44f786a_5e1e_44c5_b17f_8238f24bd589.slice/crio-3949f60266be8422d24275e828e4be8db5b1a69c339a2974f062ab26598cd3d7 WatchSource:0}: Error finding container 3949f60266be8422d24275e828e4be8db5b1a69c339a2974f062ab26598cd3d7: Status 404 returned error can't find the container with id 3949f60266be8422d24275e828e4be8db5b1a69c339a2974f062ab26598cd3d7 Jun 05 21:21:53.278699 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:53.278670 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:53.278905 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:53.278760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:53.278905 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:53.278819 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:53.278905 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:53.278863 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:21:53.278905 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:53.278897 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6744f8c88d-cmpzq: secret "image-registry-tls" not found Jun 05 21:21:53.279088 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:53.278907 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls podName:dbfc8003-7513-4157-9e67-1954dd63fec2 nodeName:}" failed. No retries permitted until 2026-06-05 21:21:54.278868351 +0000 UTC m=+197.515657527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xdf72" (UID: "dbfc8003-7513-4157-9e67-1954dd63fec2") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:53.279088 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:53.278948 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls podName:764d6a11-a12f-4d21-a9d0-c69fbb603c3a nodeName:}" failed. No retries permitted until 2026-06-05 21:21:54.278931309 +0000 UTC m=+197.515720485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls") pod "image-registry-6744f8c88d-cmpzq" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a") : secret "image-registry-tls" not found Jun 05 21:21:53.794295 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:53.794257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" event={"ID":"e44f786a-5e1e-44c5-b17f-8238f24bd589","Type":"ContainerStarted","Data":"3949f60266be8422d24275e828e4be8db5b1a69c339a2974f062ab26598cd3d7"} Jun 05 21:21:54.285730 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:54.285687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:54.285924 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:54.285805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:54.285924 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:54.285848 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:54.286049 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:54.285930 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:21:54.286049 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:54.285945 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6744f8c88d-cmpzq: secret "image-registry-tls" not found Jun 05 21:21:54.286049 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:54.285945 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls podName:dbfc8003-7513-4157-9e67-1954dd63fec2 nodeName:}" failed. No retries permitted until 2026-06-05 21:21:56.285923669 +0000 UTC m=+199.522712859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xdf72" (UID: "dbfc8003-7513-4157-9e67-1954dd63fec2") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:54.286049 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:54.285995 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls podName:764d6a11-a12f-4d21-a9d0-c69fbb603c3a nodeName:}" failed. No retries permitted until 2026-06-05 21:21:56.285978994 +0000 UTC m=+199.522768174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls") pod "image-registry-6744f8c88d-cmpzq" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a") : secret "image-registry-tls" not found Jun 05 21:21:55.803142 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:55.803115 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/0.log" Jun 05 21:21:55.803600 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:55.803154 2567 generic.go:356] "Generic (PLEG): container finished" podID="e44f786a-5e1e-44c5-b17f-8238f24bd589" containerID="1585a4ebac296138c66326caf49bc4bd536e315e8b78d35208011019b1907faf" exitCode=255 Jun 05 21:21:55.803600 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:55.803204 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" event={"ID":"e44f786a-5e1e-44c5-b17f-8238f24bd589","Type":"ContainerDied","Data":"1585a4ebac296138c66326caf49bc4bd536e315e8b78d35208011019b1907faf"} Jun 05 21:21:55.803600 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:55.803461 2567 scope.go:117] "RemoveContainer" containerID="1585a4ebac296138c66326caf49bc4bd536e315e8b78d35208011019b1907faf" Jun 05 21:21:56.300585 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.300549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:21:56.300743 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:56.300701 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:21:56.300743 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:56.300727 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6744f8c88d-cmpzq: secret "image-registry-tls" not found Jun 05 21:21:56.300818 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.300752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:21:56.300818 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:56.300788 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls podName:764d6a11-a12f-4d21-a9d0-c69fbb603c3a nodeName:}" failed. No retries permitted until 2026-06-05 21:22:00.300768538 +0000 UTC m=+203.537557720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls") pod "image-registry-6744f8c88d-cmpzq" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a") : secret "image-registry-tls" not found Jun 05 21:21:56.300923 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:56.300826 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:56.300923 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:56.300862 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls podName:dbfc8003-7513-4157-9e67-1954dd63fec2 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:00.300851108 +0000 UTC m=+203.537640290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xdf72" (UID: "dbfc8003-7513-4157-9e67-1954dd63fec2") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:21:56.807270 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.807247 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/1.log" Jun 05 21:21:56.807701 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.807682 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/0.log" Jun 05 21:21:56.807772 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.807726 2567 generic.go:356] "Generic (PLEG): container finished" podID="e44f786a-5e1e-44c5-b17f-8238f24bd589" containerID="060df0d23cd4186cf9ddf85a59485f40b2e538c8cbbf302bb2aded920f033f00" exitCode=255 Jun 05 21:21:56.807823 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.807792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" event={"ID":"e44f786a-5e1e-44c5-b17f-8238f24bd589","Type":"ContainerDied","Data":"060df0d23cd4186cf9ddf85a59485f40b2e538c8cbbf302bb2aded920f033f00"} Jun 05 21:21:56.807909 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.807850 2567 scope.go:117] "RemoveContainer" containerID="1585a4ebac296138c66326caf49bc4bd536e315e8b78d35208011019b1907faf" Jun 05 21:21:56.808041 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:56.808026 2567 scope.go:117] "RemoveContainer" containerID="060df0d23cd4186cf9ddf85a59485f40b2e538c8cbbf302bb2aded920f033f00" Jun 05 21:21:56.808214 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:56.808193 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-7vnfn_openshift-console-operator(e44f786a-5e1e-44c5-b17f-8238f24bd589)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" podUID="e44f786a-5e1e-44c5-b17f-8238f24bd589" Jun 05 21:21:57.812328 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:57.812302 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/1.log" Jun 05 21:21:57.812716 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:57.812606 2567 scope.go:117] "RemoveContainer" containerID="060df0d23cd4186cf9ddf85a59485f40b2e538c8cbbf302bb2aded920f033f00" Jun 05 21:21:57.812759 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:21:57.812739 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-7vnfn_openshift-console-operator(e44f786a-5e1e-44c5-b17f-8238f24bd589)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" podUID="e44f786a-5e1e-44c5-b17f-8238f24bd589" Jun 05 21:21:58.146505 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.146424 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b"] Jun 05 21:21:58.148735 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.148720 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" Jun 05 21:21:58.150691 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.150670 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 21:21:58.150803 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.150675 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 21:21:58.150803 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.150746 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pjm9q\"" Jun 05 21:21:58.158960 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.158939 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b"] Jun 05 21:21:58.215546 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.215514 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2rnm\" (UniqueName: \"kubernetes.io/projected/69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff-kube-api-access-v2rnm\") pod \"migrator-955ffdf5f-pxw2b\" (UID: \"69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" Jun 05 21:21:58.316265 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.316229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2rnm\" (UniqueName: \"kubernetes.io/projected/69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff-kube-api-access-v2rnm\") pod \"migrator-955ffdf5f-pxw2b\" (UID: \"69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" Jun 05 21:21:58.323772 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.323739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2rnm\" (UniqueName: \"kubernetes.io/projected/69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff-kube-api-access-v2rnm\") pod \"migrator-955ffdf5f-pxw2b\" (UID: \"69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" Jun 05 21:21:58.457284 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.457173 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" Jun 05 21:21:58.580585 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.580556 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b"] Jun 05 21:21:58.584027 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:21:58.583999 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e0dc9d_42b9_4878_9a3e_d8ddc8d030ff.slice/crio-dbcfc12159c6d9ec7fba81fe6867c3766b892e24c626714213b6ff038ca4e47e WatchSource:0}: Error finding container dbcfc12159c6d9ec7fba81fe6867c3766b892e24c626714213b6ff038ca4e47e: Status 404 returned error can't find the container with id dbcfc12159c6d9ec7fba81fe6867c3766b892e24c626714213b6ff038ca4e47e Jun 05 21:21:58.815799 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:58.815760 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" event={"ID":"69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff","Type":"ContainerStarted","Data":"dbcfc12159c6d9ec7fba81fe6867c3766b892e24c626714213b6ff038ca4e47e"} Jun 05 21:21:59.576367 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:59.576341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8zxjn_3b207abd-2216-45ce-84fe-1f49a8c0b49c/dns-node-resolver/0.log" Jun 05 21:21:59.820321 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:59.820287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" event={"ID":"69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff","Type":"ContainerStarted","Data":"fdc7235d74a6415b764143d039987f5fa51e521c869dfd7855a4963471308e75"} Jun 05 21:21:59.820679 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:59.820336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" event={"ID":"69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff","Type":"ContainerStarted","Data":"5767ced19743a0ab783305a3957883922769ec4fb3c370df871330f7ea6d76bb"} Jun 05 21:21:59.838774 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:21:59.838697 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-pxw2b" podStartSLOduration=0.985252369 podStartE2EDuration="1.838675247s" totalImagesPullingTime="853.422878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:59.836812063 +0000 UTC m=+203.073601260" watchObservedRunningTime="2026-06-05 21:21:59.838675247 +0000 UTC m=+203.075464446" Jun 05 21:22:00.330400 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.330373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:22:00.330548 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.330417 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:22:00.330548 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:00.330512 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:22:00.330548 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:00.330522 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:22:00.330548 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:00.330540 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6744f8c88d-cmpzq: secret "image-registry-tls" not found Jun 05 21:22:00.330695 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:00.330559 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls podName:dbfc8003-7513-4157-9e67-1954dd63fec2 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:08.330547119 +0000 UTC m=+211.567336300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xdf72" (UID: "dbfc8003-7513-4157-9e67-1954dd63fec2") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:22:00.330695 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:00.330584 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls podName:764d6a11-a12f-4d21-a9d0-c69fbb603c3a nodeName:}" failed. No retries permitted until 2026-06-05 21:22:08.330570789 +0000 UTC m=+211.567359965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls") pod "image-registry-6744f8c88d-cmpzq" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a") : secret "image-registry-tls" not found Jun 05 21:22:00.532295 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.532260 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z2g6t"] Jun 05 21:22:00.534699 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.534684 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.536608 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.536581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 05 21:22:00.536843 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.536825 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 05 21:22:00.536937 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.536826 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dj4kg\"" Jun 05 21:22:00.536937 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.536908 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 05 21:22:00.537048 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.536988 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 05 21:22:00.544004 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.543981 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z2g6t"] Jun 05 21:22:00.633182 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.633096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f1c61df-7b7b-4c20-a117-099cca823764-signing-cabundle\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.633182 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.633137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7g4\" (UniqueName: \"kubernetes.io/projected/1f1c61df-7b7b-4c20-a117-099cca823764-kube-api-access-sl7g4\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.633371 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.633266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f1c61df-7b7b-4c20-a117-099cca823764-signing-key\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.734206 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.734165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f1c61df-7b7b-4c20-a117-099cca823764-signing-key\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.734389 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.734228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f1c61df-7b7b-4c20-a117-099cca823764-signing-cabundle\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.734389 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.734245 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7g4\" (UniqueName: \"kubernetes.io/projected/1f1c61df-7b7b-4c20-a117-099cca823764-kube-api-access-sl7g4\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.735042 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.735007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1f1c61df-7b7b-4c20-a117-099cca823764-signing-cabundle\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.736672 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.736649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1f1c61df-7b7b-4c20-a117-099cca823764-signing-key\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.742127 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.742104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7g4\" (UniqueName: \"kubernetes.io/projected/1f1c61df-7b7b-4c20-a117-099cca823764-kube-api-access-sl7g4\") pod \"service-ca-7d74d578b8-z2g6t\" (UID: \"1f1c61df-7b7b-4c20-a117-099cca823764\") " pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.843043 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.843005 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" Jun 05 21:22:00.965198 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.965167 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z2g6t"] Jun 05 21:22:00.970511 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:00.970477 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1c61df_7b7b_4c20_a117_099cca823764.slice/crio-d8b8797e23abbb93a311b3f4ee93c6c21de02dd7a8ba743d9e40869c2d2ef00d WatchSource:0}: Error finding container d8b8797e23abbb93a311b3f4ee93c6c21de02dd7a8ba743d9e40869c2d2ef00d: Status 404 returned error can't find the container with id d8b8797e23abbb93a311b3f4ee93c6c21de02dd7a8ba743d9e40869c2d2ef00d Jun 05 21:22:00.976199 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:00.976175 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rd274_e35c1474-69c4-4617-aeba-eef3e7b9a3a9/node-ca/0.log" Jun 05 21:22:01.577169 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:01.577140 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghwzl_b9f552dd-786d-49ac-b51b-5987fc28c830/serve-healthcheck-canary/0.log" Jun 05 21:22:01.828391 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:01.828302 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" event={"ID":"1f1c61df-7b7b-4c20-a117-099cca823764","Type":"ContainerStarted","Data":"d8b8797e23abbb93a311b3f4ee93c6c21de02dd7a8ba743d9e40869c2d2ef00d"} Jun 05 21:22:02.963122 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:02.963086 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:22:02.963489 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:02.963141 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:22:02.963489 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:02.963452 2567 scope.go:117] "RemoveContainer" containerID="060df0d23cd4186cf9ddf85a59485f40b2e538c8cbbf302bb2aded920f033f00" Jun 05 21:22:02.963599 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:02.963580 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-7vnfn_openshift-console-operator(e44f786a-5e1e-44c5-b17f-8238f24bd589)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" podUID="e44f786a-5e1e-44c5-b17f-8238f24bd589" Jun 05 21:22:03.835419 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:03.835387 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" event={"ID":"1f1c61df-7b7b-4c20-a117-099cca823764","Type":"ContainerStarted","Data":"8a8454206410acd3e8e8e95975405cc446df27f25df7225149ae90c7faf6e930"} Jun 05 21:22:03.850349 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:03.850299 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-z2g6t" podStartSLOduration=2.035773804 podStartE2EDuration="3.850284561s" totalImagesPullingTime="1.814510757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:03.849224887 +0000 UTC m=+207.086014107" watchObservedRunningTime="2026-06-05 21:22:03.850284561 +0000 UTC m=+207.087073758" Jun 05 21:22:08.393827 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.393779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:22:08.394241 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.393853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:22:08.394241 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:08.393990 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 21:22:08.394241 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:08.394056 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls podName:dbfc8003-7513-4157-9e67-1954dd63fec2 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:24.394038543 +0000 UTC m=+227.630827735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-xdf72" (UID: "dbfc8003-7513-4157-9e67-1954dd63fec2") : secret "cluster-monitoring-operator-tls" not found Jun 05 21:22:08.396409 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.396378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"image-registry-6744f8c88d-cmpzq\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:22:08.471385 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.471351 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:22:08.609672 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.609634 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6744f8c88d-cmpzq"] Jun 05 21:22:08.612261 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:08.612224 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764d6a11_a12f_4d21_a9d0_c69fbb603c3a.slice/crio-f192c582f78acf273ff4826c8d19390e5264facf67c474d44c650f4bc6eb6e3a WatchSource:0}: Error finding container f192c582f78acf273ff4826c8d19390e5264facf67c474d44c650f4bc6eb6e3a: Status 404 returned error can't find the container with id f192c582f78acf273ff4826c8d19390e5264facf67c474d44c650f4bc6eb6e3a Jun 05 21:22:08.855058 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.855013 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" event={"ID":"764d6a11-a12f-4d21-a9d0-c69fbb603c3a","Type":"ContainerStarted","Data":"c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5"} Jun 05 21:22:08.855211 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.855073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" event={"ID":"764d6a11-a12f-4d21-a9d0-c69fbb603c3a","Type":"ContainerStarted","Data":"f192c582f78acf273ff4826c8d19390e5264facf67c474d44c650f4bc6eb6e3a"} Jun 05 21:22:08.855211 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.855102 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:22:08.876054 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:08.875994 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" podStartSLOduration=16.87597368 podStartE2EDuration="16.87597368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:08.874160217 +0000 UTC m=+212.110949417" watchObservedRunningTime="2026-06-05 21:22:08.87597368 +0000 UTC m=+212.112762881" Jun 05 21:22:14.192447 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:14.192410 2567 scope.go:117] "RemoveContainer" containerID="060df0d23cd4186cf9ddf85a59485f40b2e538c8cbbf302bb2aded920f033f00" Jun 05 21:22:14.874329 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:14.874300 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:22:14.874727 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:14.874712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/1.log" Jun 05 21:22:14.874791 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:14.874743 2567 generic.go:356] "Generic (PLEG): container finished" podID="e44f786a-5e1e-44c5-b17f-8238f24bd589" containerID="f836ee30fa30ad432f7140e9781c74b4eeb3177150819a561423a195c23c7162" exitCode=255 Jun 05 21:22:14.874824 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:14.874798 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" event={"ID":"e44f786a-5e1e-44c5-b17f-8238f24bd589","Type":"ContainerDied","Data":"f836ee30fa30ad432f7140e9781c74b4eeb3177150819a561423a195c23c7162"} Jun 05 21:22:14.874864 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:14.874841 2567 scope.go:117] "RemoveContainer" containerID="060df0d23cd4186cf9ddf85a59485f40b2e538c8cbbf302bb2aded920f033f00" Jun 05 21:22:14.875157 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:14.875143 2567 scope.go:117] "RemoveContainer" containerID="f836ee30fa30ad432f7140e9781c74b4eeb3177150819a561423a195c23c7162" Jun 05 21:22:14.875320 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:14.875302 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-7vnfn_openshift-console-operator(e44f786a-5e1e-44c5-b17f-8238f24bd589)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" podUID="e44f786a-5e1e-44c5-b17f-8238f24bd589" Jun 05 21:22:15.878841 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:15.878814 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:22:21.201655 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.201626 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6744f8c88d-cmpzq"] Jun 05 21:22:21.315010 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.314972 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2rjgk"] Jun 05 21:22:21.318092 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.318071 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.320250 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.320229 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 21:22:21.320250 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.320242 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w7t9j\"" Jun 05 21:22:21.320399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.320230 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 21:22:21.320804 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.320779 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 21:22:21.320933 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.320916 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 21:22:21.336082 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.336062 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2rjgk"] Jun 05 21:22:21.391142 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.391101 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3835afd-8e1e-49b3-8ff6-39de7f313375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.391333 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.391165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3835afd-8e1e-49b3-8ff6-39de7f313375-data-volume\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.391333 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.391211 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2klk\" (UniqueName: \"kubernetes.io/projected/c3835afd-8e1e-49b3-8ff6-39de7f313375-kube-api-access-b2klk\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.391333 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.391233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3835afd-8e1e-49b3-8ff6-39de7f313375-crio-socket\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.391333 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.391254 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3835afd-8e1e-49b3-8ff6-39de7f313375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492187 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2klk\" (UniqueName: \"kubernetes.io/projected/c3835afd-8e1e-49b3-8ff6-39de7f313375-kube-api-access-b2klk\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492187 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3835afd-8e1e-49b3-8ff6-39de7f313375-crio-socket\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492187 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3835afd-8e1e-49b3-8ff6-39de7f313375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492441 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3835afd-8e1e-49b3-8ff6-39de7f313375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492441 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3835afd-8e1e-49b3-8ff6-39de7f313375-data-volume\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492441 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3835afd-8e1e-49b3-8ff6-39de7f313375-crio-socket\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492668 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492646 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3835afd-8e1e-49b3-8ff6-39de7f313375-data-volume\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.492777 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.492760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3835afd-8e1e-49b3-8ff6-39de7f313375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.494463 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.494447 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3835afd-8e1e-49b3-8ff6-39de7f313375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.502648 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.502621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2klk\" (UniqueName: \"kubernetes.io/projected/c3835afd-8e1e-49b3-8ff6-39de7f313375-kube-api-access-b2klk\") pod \"insights-runtime-extractor-2rjgk\" (UID: \"c3835afd-8e1e-49b3-8ff6-39de7f313375\") " pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.627564 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.627530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2rjgk" Jun 05 21:22:21.748767 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.748697 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2rjgk"] Jun 05 21:22:21.752244 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:21.752223 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3835afd_8e1e_49b3_8ff6_39de7f313375.slice/crio-431212fe48eeb24896f88b208823c9a91236b037d7563155e10ed9484eaee860 WatchSource:0}: Error finding container 431212fe48eeb24896f88b208823c9a91236b037d7563155e10ed9484eaee860: Status 404 returned error can't find the container with id 431212fe48eeb24896f88b208823c9a91236b037d7563155e10ed9484eaee860 Jun 05 21:22:21.898070 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.898032 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rjgk" event={"ID":"c3835afd-8e1e-49b3-8ff6-39de7f313375","Type":"ContainerStarted","Data":"1e2c019c825a417f1d9826ef901181ded2e5cf0ea4089337238922aa118a896e"} Jun 05 21:22:21.898225 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:21.898089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rjgk" event={"ID":"c3835afd-8e1e-49b3-8ff6-39de7f313375","Type":"ContainerStarted","Data":"431212fe48eeb24896f88b208823c9a91236b037d7563155e10ed9484eaee860"} Jun 05 21:22:22.902068 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:22.902035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rjgk" event={"ID":"c3835afd-8e1e-49b3-8ff6-39de7f313375","Type":"ContainerStarted","Data":"ddec4d69b590686cec07de07efd833e0b8de9eb921c6d9983993e5097d67d0c1"} Jun 05 21:22:22.962952 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:22.962902 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:22:22.963094 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:22.962972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:22:22.963312 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:22.963293 2567 scope.go:117] "RemoveContainer" containerID="f836ee30fa30ad432f7140e9781c74b4eeb3177150819a561423a195c23c7162" Jun 05 21:22:22.963489 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:22.963468 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-7vnfn_openshift-console-operator(e44f786a-5e1e-44c5-b17f-8238f24bd589)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" podUID="e44f786a-5e1e-44c5-b17f-8238f24bd589" Jun 05 21:22:24.417404 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:24.417371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:22:24.419684 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:24.419649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbfc8003-7513-4157-9e67-1954dd63fec2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-xdf72\" (UID: \"dbfc8003-7513-4157-9e67-1954dd63fec2\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:22:24.665425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:24.665367 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" Jun 05 21:22:24.791152 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:24.791123 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72"] Jun 05 21:22:24.794132 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:24.794099 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfc8003_7513_4157_9e67_1954dd63fec2.slice/crio-ea51fb13afd8332a5286d90ff4c215e83afa552a4bf6ff321032819884349a27 WatchSource:0}: Error finding container ea51fb13afd8332a5286d90ff4c215e83afa552a4bf6ff321032819884349a27: Status 404 returned error can't find the container with id ea51fb13afd8332a5286d90ff4c215e83afa552a4bf6ff321032819884349a27 Jun 05 21:22:24.909017 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:24.908978 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" event={"ID":"dbfc8003-7513-4157-9e67-1954dd63fec2","Type":"ContainerStarted","Data":"ea51fb13afd8332a5286d90ff4c215e83afa552a4bf6ff321032819884349a27"} Jun 05 21:22:24.910863 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:24.910840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2rjgk" event={"ID":"c3835afd-8e1e-49b3-8ff6-39de7f313375","Type":"ContainerStarted","Data":"f6040b458c8ff394216c1a257b9a1cd006eb5198138f8e3bd8714b8c3a86c6eb"} Jun 05 21:22:24.927289 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:24.927201 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2rjgk" podStartSLOduration=1.921811197 podStartE2EDuration="3.927187753s" totalImagesPullingTime="2.005376556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:22:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:24.926144818 +0000 UTC m=+228.162934034" watchObservedRunningTime="2026-06-05 21:22:24.927187753 +0000 UTC m=+228.163976947" Jun 05 21:22:27.922119 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:27.922085 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" event={"ID":"dbfc8003-7513-4157-9e67-1954dd63fec2","Type":"ContainerStarted","Data":"8e7fe08bd4889f186566c806762a948ceabf9fc52d57f9cb368e9f9197a9e4f4"} Jun 05 21:22:27.937066 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:27.937008 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-xdf72" podStartSLOduration=33.724518789 podStartE2EDuration="35.93699267s" totalImagesPullingTime="2.212473881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:27.936501875 +0000 UTC m=+231.173291074" watchObservedRunningTime="2026-06-05 21:22:27.93699267 +0000 UTC m=+231.173781868" Jun 05 21:22:31.207210 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:31.207177 2567 patch_prober.go:28] interesting pod/image-registry-6744f8c88d-cmpzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:22:31.207548 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:31.207223 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" podUID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:22:34.911508 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:34.911469 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7ddhz"] Jun 05 21:22:34.914835 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:34.914816 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:34.916962 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:34.916934 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 21:22:34.917095 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:34.916973 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 21:22:34.917284 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:34.917268 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wpcm7\"" Jun 05 21:22:34.917548 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:34.917526 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 21:22:34.918229 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:34.918214 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 21:22:35.000784 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.000749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-root\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.000784 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.000794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.001025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.000822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-textfile\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.001025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.000845 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-sys\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.001025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.000937 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-tls\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.001025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.000978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-wtmp\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.001025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.001003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a744b16b-dfc3-4408-b562-ea3787d4adba-metrics-client-ca\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.001203 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.001028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwf7n\" (UniqueName: \"kubernetes.io/projected/a744b16b-dfc3-4408-b562-ea3787d4adba-kube-api-access-mwf7n\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.001203 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.001119 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102012 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.101974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102031 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-root\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-textfile\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-sys\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-tls\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-wtmp\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a744b16b-dfc3-4408-b562-ea3787d4adba-metrics-client-ca\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwf7n\" (UniqueName: \"kubernetes.io/projected/a744b16b-dfc3-4408-b562-ea3787d4adba-kube-api-access-mwf7n\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102593 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102198 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-root\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102593 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-sys\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102593 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-wtmp\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102593 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-textfile\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102719 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102625 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.102975 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.102956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a744b16b-dfc3-4408-b562-ea3787d4adba-metrics-client-ca\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.104543 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.104521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.104641 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.104564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a744b16b-dfc3-4408-b562-ea3787d4adba-node-exporter-tls\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.110916 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.110870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwf7n\" (UniqueName: \"kubernetes.io/projected/a744b16b-dfc3-4408-b562-ea3787d4adba-kube-api-access-mwf7n\") pod \"node-exporter-7ddhz\" (UID: \"a744b16b-dfc3-4408-b562-ea3787d4adba\") " pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.225984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.225900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7ddhz" Jun 05 21:22:35.238109 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:35.238058 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda744b16b_dfc3_4408_b562_ea3787d4adba.slice/crio-15784cbc351b3b48fb0995679e625badb2cb2c792604a45239df76249cf08c9b WatchSource:0}: Error finding container 15784cbc351b3b48fb0995679e625badb2cb2c792604a45239df76249cf08c9b: Status 404 returned error can't find the container with id 15784cbc351b3b48fb0995679e625badb2cb2c792604a45239df76249cf08c9b Jun 05 21:22:35.949221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:35.949179 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ddhz" event={"ID":"a744b16b-dfc3-4408-b562-ea3787d4adba","Type":"ContainerStarted","Data":"15784cbc351b3b48fb0995679e625badb2cb2c792604a45239df76249cf08c9b"} Jun 05 21:22:36.896844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.896811 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d755cc74f-kcnq4"] Jun 05 21:22:36.900107 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.900090 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:36.902341 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.902279 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 21:22:36.902341 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.902311 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 21:22:36.902341 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.902328 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 21:22:36.902598 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.902405 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f5mqs\"" Jun 05 21:22:36.902598 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.902587 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 21:22:36.902698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.902614 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 21:22:36.902740 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.902729 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6g7haika7uo55\"" Jun 05 21:22:36.909897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.909865 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d755cc74f-kcnq4"] Jun 05 21:22:36.954284 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.954247 2567 generic.go:356] "Generic (PLEG): container finished" podID="a744b16b-dfc3-4408-b562-ea3787d4adba" containerID="bc0a9c9a7e5724fd71dd415371229a1c6ea7d24f7085842cce4a598a91b34bc6" exitCode=0 Jun 05 21:22:36.954710 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:36.954338 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ddhz" event={"ID":"a744b16b-dfc3-4408-b562-ea3787d4adba","Type":"ContainerDied","Data":"bc0a9c9a7e5724fd71dd415371229a1c6ea7d24f7085842cce4a598a91b34bc6"} Jun 05 21:22:37.018168 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018144 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.018280 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.018280 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018221 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.018280 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-tls\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.018437 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghzx8\" (UniqueName: \"kubernetes.io/projected/143eaca0-f839-4760-a28e-41bfec2e58bf-kube-api-access-ghzx8\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.018437 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143eaca0-f839-4760-a28e-41bfec2e58bf-metrics-client-ca\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.018437 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-grpc-tls\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.018437 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.018382 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.119912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.119857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.119912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.119916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.120147 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.120001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.120147 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.120067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-tls\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.120147 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.120095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghzx8\" (UniqueName: \"kubernetes.io/projected/143eaca0-f839-4760-a28e-41bfec2e58bf-kube-api-access-ghzx8\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.120147 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.120128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143eaca0-f839-4760-a28e-41bfec2e58bf-metrics-client-ca\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.120411 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.120152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-grpc-tls\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.120411 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.120226 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.121033 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.121012 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143eaca0-f839-4760-a28e-41bfec2e58bf-metrics-client-ca\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.122193 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.122157 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 21:22:37.122193 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.122160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 21:22:37.122380 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.122160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 21:22:37.122380 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.122219 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6g7haika7uo55\"" Jun 05 21:22:37.122380 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.122265 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 21:22:37.122380 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.122271 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 21:22:37.130486 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.130458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghzx8\" (UniqueName: \"kubernetes.io/projected/143eaca0-f839-4760-a28e-41bfec2e58bf-kube-api-access-ghzx8\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.133288 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.133260 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.133404 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.133270 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-tls\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.133404 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.133355 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.133517 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.133426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.133517 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.133491 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-grpc-tls\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.133713 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.133697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/143eaca0-f839-4760-a28e-41bfec2e58bf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d755cc74f-kcnq4\" (UID: \"143eaca0-f839-4760-a28e-41bfec2e58bf\") " pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.193799 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.193728 2567 scope.go:117] "RemoveContainer" containerID="f836ee30fa30ad432f7140e9781c74b4eeb3177150819a561423a195c23c7162" Jun 05 21:22:37.211705 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.211682 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f5mqs\"" Jun 05 21:22:37.219919 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.219893 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:37.382010 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.381978 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d755cc74f-kcnq4"] Jun 05 21:22:37.385779 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:37.385749 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143eaca0_f839_4760_a28e_41bfec2e58bf.slice/crio-5bb9e91f166bf1b7d1eedc296d443c1f3cc75c6d92b5673524add8b9b08b00c8 WatchSource:0}: Error finding container 5bb9e91f166bf1b7d1eedc296d443c1f3cc75c6d92b5673524add8b9b08b00c8: Status 404 returned error can't find the container with id 5bb9e91f166bf1b7d1eedc296d443c1f3cc75c6d92b5673524add8b9b08b00c8 Jun 05 21:22:37.960069 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.960038 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:22:37.960537 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.960176 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" event={"ID":"e44f786a-5e1e-44c5-b17f-8238f24bd589","Type":"ContainerStarted","Data":"800914fdddd1a70ad09e5e91baa62acdf62b5abc8b0aa96bc0850479b6acce36"} Jun 05 21:22:37.960604 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.960552 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:22:37.961489 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.961462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" event={"ID":"143eaca0-f839-4760-a28e-41bfec2e58bf","Type":"ContainerStarted","Data":"5bb9e91f166bf1b7d1eedc296d443c1f3cc75c6d92b5673524add8b9b08b00c8"} Jun 05 21:22:37.963702 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.963673 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ddhz" event={"ID":"a744b16b-dfc3-4408-b562-ea3787d4adba","Type":"ContainerStarted","Data":"8128a3b21e5da8eb8cc7a91fb0fd88277c8fed7ac5a167c6a113466c2099c714"} Jun 05 21:22:37.963810 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.963721 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ddhz" event={"ID":"a744b16b-dfc3-4408-b562-ea3787d4adba","Type":"ContainerStarted","Data":"6c39dc3cfe5888f59687054696adaa546597e9c41f550d6e457efd2873a7c93c"} Jun 05 21:22:37.977173 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.977075 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" podStartSLOduration=43.926833384 podStartE2EDuration="45.977057234s" totalImagesPullingTime="2.05022385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:37.976142789 +0000 UTC m=+241.212932005" watchObservedRunningTime="2026-06-05 21:22:37.977057234 +0000 UTC m=+241.213846433" Jun 05 21:22:37.992822 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:37.992773 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7ddhz" podStartSLOduration=3.001619024 podStartE2EDuration="3.992755748s" totalImagesPullingTime="926.577521ms" totalInitContainerRuntime="64.559203ms" isStatefulPod=true podCreationTimestamp="2026-06-05 21:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:37.991750338 +0000 UTC m=+241.228539566" watchObservedRunningTime="2026-06-05 21:22:37.992755748 +0000 UTC m=+241.229544948" Jun 05 21:22:38.065807 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.065752 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-7vnfn" Jun 05 21:22:38.258690 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.258606 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-x58hc"] Jun 05 21:22:38.261977 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.261953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-x58hc" Jun 05 21:22:38.264397 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.264378 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 21:22:38.265393 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.265373 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j4jdj\"" Jun 05 21:22:38.266021 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.266000 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 21:22:38.291376 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.291341 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-x58hc"] Jun 05 21:22:38.432680 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.432640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4br6\" (UniqueName: \"kubernetes.io/projected/611e9f75-b10e-4cf3-a84c-a74af9d7996b-kube-api-access-j4br6\") pod \"downloads-6657875f97-x58hc\" (UID: \"611e9f75-b10e-4cf3-a84c-a74af9d7996b\") " pod="openshift-console/downloads-6657875f97-x58hc" Jun 05 21:22:38.533270 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.533228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4br6\" (UniqueName: \"kubernetes.io/projected/611e9f75-b10e-4cf3-a84c-a74af9d7996b-kube-api-access-j4br6\") pod \"downloads-6657875f97-x58hc\" (UID: \"611e9f75-b10e-4cf3-a84c-a74af9d7996b\") " pod="openshift-console/downloads-6657875f97-x58hc" Jun 05 21:22:38.542310 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.542282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4br6\" (UniqueName: \"kubernetes.io/projected/611e9f75-b10e-4cf3-a84c-a74af9d7996b-kube-api-access-j4br6\") pod \"downloads-6657875f97-x58hc\" (UID: \"611e9f75-b10e-4cf3-a84c-a74af9d7996b\") " pod="openshift-console/downloads-6657875f97-x58hc" Jun 05 21:22:38.573161 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.573124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-x58hc" Jun 05 21:22:38.713216 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:38.713179 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-x58hc"] Jun 05 21:22:39.217085 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:39.217052 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611e9f75_b10e_4cf3_a84c_a74af9d7996b.slice/crio-b19d68c7bfe9e35627aaef67dcf57ad3cb8661bd4814bb710ab89a767b11dece WatchSource:0}: Error finding container b19d68c7bfe9e35627aaef67dcf57ad3cb8661bd4814bb710ab89a767b11dece: Status 404 returned error can't find the container with id b19d68c7bfe9e35627aaef67dcf57ad3cb8661bd4814bb710ab89a767b11dece Jun 05 21:22:39.289127 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.289098 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c44f44476-j26qp"] Jun 05 21:22:39.293210 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.293195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.297325 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.297306 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 05 21:22:39.297414 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.297349 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bbj42a4larq0i\"" Jun 05 21:22:39.297633 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.297610 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 05 21:22:39.297733 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.297634 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 05 21:22:39.297733 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.297618 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 21:22:39.297733 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.297699 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-99clc\"" Jun 05 21:22:39.316031 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.316002 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c44f44476-j26qp"] Jun 05 21:22:39.442028 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.441948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50439b98-57b8-4ad3-a439-f7687e67f9bf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.442028 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.441995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50439b98-57b8-4ad3-a439-f7687e67f9bf-metrics-server-audit-profiles\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.442170 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.442077 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-secret-metrics-server-client-certs\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.442170 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.442118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-secret-metrics-server-tls\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.442170 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.442135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xtlq\" (UniqueName: \"kubernetes.io/projected/50439b98-57b8-4ad3-a439-f7687e67f9bf-kube-api-access-4xtlq\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.442170 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.442163 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50439b98-57b8-4ad3-a439-f7687e67f9bf-audit-log\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.442322 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.442186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-client-ca-bundle\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543357 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50439b98-57b8-4ad3-a439-f7687e67f9bf-audit-log\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543533 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-client-ca-bundle\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543533 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50439b98-57b8-4ad3-a439-f7687e67f9bf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543533 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50439b98-57b8-4ad3-a439-f7687e67f9bf-metrics-server-audit-profiles\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543533 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-secret-metrics-server-client-certs\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543734 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-secret-metrics-server-tls\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543734 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xtlq\" (UniqueName: \"kubernetes.io/projected/50439b98-57b8-4ad3-a439-f7687e67f9bf-kube-api-access-4xtlq\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.543830 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.543771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50439b98-57b8-4ad3-a439-f7687e67f9bf-audit-log\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.544234 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.544210 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50439b98-57b8-4ad3-a439-f7687e67f9bf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.544568 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.544544 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50439b98-57b8-4ad3-a439-f7687e67f9bf-metrics-server-audit-profiles\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.546113 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.546094 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-client-ca-bundle\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.546425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.546409 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-secret-metrics-server-tls\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.546480 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.546440 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50439b98-57b8-4ad3-a439-f7687e67f9bf-secret-metrics-server-client-certs\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.550640 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.550618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xtlq\" (UniqueName: \"kubernetes.io/projected/50439b98-57b8-4ad3-a439-f7687e67f9bf-kube-api-access-4xtlq\") pod \"metrics-server-6c44f44476-j26qp\" (UID: \"50439b98-57b8-4ad3-a439-f7687e67f9bf\") " pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.607612 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.607578 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:39.679329 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.679298 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp"] Jun 05 21:22:39.683557 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.683534 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:39.685540 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.685513 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 21:22:39.685540 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.685513 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6hvlc\"" Jun 05 21:22:39.692016 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.691652 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp"] Jun 05 21:22:39.746297 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.746262 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c44f44476-j26qp"] Jun 05 21:22:39.749469 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:39.749437 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50439b98_57b8_4ad3_a439_f7687e67f9bf.slice/crio-2d7508fd02295c5cd030db3bb5976bddf2a2d2e069729eb493d7f8185ffc356f WatchSource:0}: Error finding container 2d7508fd02295c5cd030db3bb5976bddf2a2d2e069729eb493d7f8185ffc356f: Status 404 returned error can't find the container with id 2d7508fd02295c5cd030db3bb5976bddf2a2d2e069729eb493d7f8185ffc356f Jun 05 21:22:39.847594 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.847509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn97k\" (UniqueName: \"kubernetes.io/projected/0385f27d-f89a-4442-9160-a434eed39a2f-kube-api-access-gn97k\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:39.847594 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.847571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:39.948616 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.948569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn97k\" (UniqueName: \"kubernetes.io/projected/0385f27d-f89a-4442-9160-a434eed39a2f-kube-api-access-gn97k\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:39.948784 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.948630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:39.948862 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:39.948820 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 21:22:39.948950 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:39.948902 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert podName:0385f27d-f89a-4442-9160-a434eed39a2f nodeName:}" failed. No retries permitted until 2026-06-05 21:22:40.44886293 +0000 UTC m=+243.685652123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-gqtpp" (UID: "0385f27d-f89a-4442-9160-a434eed39a2f") : secret "monitoring-plugin-cert" not found Jun 05 21:22:39.957077 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.957050 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn97k\" (UniqueName: \"kubernetes.io/projected/0385f27d-f89a-4442-9160-a434eed39a2f-kube-api-access-gn97k\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:39.973864 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.973832 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" event={"ID":"143eaca0-f839-4760-a28e-41bfec2e58bf","Type":"ContainerStarted","Data":"9eb46e901a4f227effc6a27c2691328f1f2b504699254e4250ae61174ab95ee0"} Jun 05 21:22:39.974021 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.973946 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" event={"ID":"143eaca0-f839-4760-a28e-41bfec2e58bf","Type":"ContainerStarted","Data":"df876eaaef44505840a210fad4a61cc13bd0c28a5eebf6366aaea5d530799729"} Jun 05 21:22:39.974021 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.973990 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" event={"ID":"143eaca0-f839-4760-a28e-41bfec2e58bf","Type":"ContainerStarted","Data":"8257ecd17d9887a6e62cabe0c162c80a6c37f1546de19e2d5291aa9f9a0ee970"} Jun 05 21:22:39.975031 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.975008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" event={"ID":"50439b98-57b8-4ad3-a439-f7687e67f9bf","Type":"ContainerStarted","Data":"2d7508fd02295c5cd030db3bb5976bddf2a2d2e069729eb493d7f8185ffc356f"} Jun 05 21:22:39.976614 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:39.976594 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-x58hc" event={"ID":"611e9f75-b10e-4cf3-a84c-a74af9d7996b","Type":"ContainerStarted","Data":"b19d68c7bfe9e35627aaef67dcf57ad3cb8661bd4814bb710ab89a767b11dece"} Jun 05 21:22:40.454581 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:40.454524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:40.454952 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:40.454659 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 21:22:40.454952 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:40.454720 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert podName:0385f27d-f89a-4442-9160-a434eed39a2f nodeName:}" failed. No retries permitted until 2026-06-05 21:22:41.454701274 +0000 UTC m=+244.691490469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-gqtpp" (UID: "0385f27d-f89a-4442-9160-a434eed39a2f") : secret "monitoring-plugin-cert" not found Jun 05 21:22:40.984716 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:40.984659 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" event={"ID":"143eaca0-f839-4760-a28e-41bfec2e58bf","Type":"ContainerStarted","Data":"7cfc4d5cca54aea98424127934a3f00431fbf16c1e89e99ba13c9bf7e4e9f455"} Jun 05 21:22:40.984942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:40.984749 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" event={"ID":"143eaca0-f839-4760-a28e-41bfec2e58bf","Type":"ContainerStarted","Data":"1d05036309a794bb134ca0a60b78ec008afd40a82d7679a4bbf409606fd0a8c7"} Jun 05 21:22:40.984942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:40.984798 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" event={"ID":"143eaca0-f839-4760-a28e-41bfec2e58bf","Type":"ContainerStarted","Data":"a683929b68a4ec7f19f4522df349f41c7bc2debfb1bca5de96cf8a9ae3765173"} Jun 05 21:22:40.984942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:40.984844 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:41.008427 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.008371 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" podStartSLOduration=2.218735111 podStartE2EDuration="5.008354747s" totalImagesPullingTime="2.789619636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:41.007006457 +0000 UTC m=+244.243795673" watchObservedRunningTime="2026-06-05 21:22:41.008354747 +0000 UTC m=+244.245143945" Jun 05 21:22:41.105406 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.105372 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:22:41.109703 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.109675 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.112015 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.111991 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 21:22:41.112143 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112074 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 21:22:41.112143 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 21:22:41.112143 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112086 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 21:22:41.112323 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112221 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 21:22:41.112480 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112459 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 21:22:41.112560 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112525 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5shfs\"" Jun 05 21:22:41.112947 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112752 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ldu6ssdji9uj\"" Jun 05 21:22:41.112947 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.112868 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 21:22:41.113340 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.113143 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 21:22:41.113340 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.113150 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 21:22:41.113340 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.113261 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 21:22:41.113504 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.113388 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 21:22:41.113504 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.113485 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 21:22:41.113607 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.113537 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 21:22:41.115425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.115407 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 21:22:41.124693 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.124668 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:22:41.208351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.208312 2567 patch_prober.go:28] interesting pod/image-registry-6744f8c88d-cmpzq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:22:41.208509 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.208366 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" podUID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:22:41.263268 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263268 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263268 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54p4s\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-kube-api-access-54p4s\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.263844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.264163 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263851 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.264163 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.263905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.364779 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.364734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.364994 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.364788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365133 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54p4s\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-kube-api-access-54p4s\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365222 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365283 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365331 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365331 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365423 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365346 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365423 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365423 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365553 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365553 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.365553 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.365986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.366178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.366900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.367638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368588 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368710 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.368783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.369399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.369345 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.370134 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.369606 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.372912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.372112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.372912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.372239 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.372912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.372273 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.372912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.372722 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.373320 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.373279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.373837 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.373791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.374367 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.374335 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.375227 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.374952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.375322 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.375300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.375608 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.375447 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.375608 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.375572 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.376698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.376660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54p4s\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-kube-api-access-54p4s\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.376930 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.376867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.422830 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.422638 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:41.469892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.469834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:41.473529 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.473503 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0385f27d-f89a-4442-9160-a434eed39a2f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gqtpp\" (UID: \"0385f27d-f89a-4442-9160-a434eed39a2f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:41.495348 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.495313 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:41.714351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.714306 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp"] Jun 05 21:22:41.717943 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:41.717868 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0385f27d_f89a_4442_9160_a434eed39a2f.slice/crio-e7519ba2a0e3eee0422c46ff55516593aa4bf7b921988ba66831e798c03b5224 WatchSource:0}: Error finding container e7519ba2a0e3eee0422c46ff55516593aa4bf7b921988ba66831e798c03b5224: Status 404 returned error can't find the container with id e7519ba2a0e3eee0422c46ff55516593aa4bf7b921988ba66831e798c03b5224 Jun 05 21:22:41.738847 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.738811 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:22:41.743542 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:41.743512 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c44dc24_1540_4d9b_9a2a_4411392ec0ae.slice/crio-81961aaa294f1f321950b8241d7b03b3c4d224c58d13bc71a77ebc5d5b947d4a WatchSource:0}: Error finding container 81961aaa294f1f321950b8241d7b03b3c4d224c58d13bc71a77ebc5d5b947d4a: Status 404 returned error can't find the container with id 81961aaa294f1f321950b8241d7b03b3c4d224c58d13bc71a77ebc5d5b947d4a Jun 05 21:22:41.991259 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.991175 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" event={"ID":"0385f27d-f89a-4442-9160-a434eed39a2f","Type":"ContainerStarted","Data":"e7519ba2a0e3eee0422c46ff55516593aa4bf7b921988ba66831e798c03b5224"} Jun 05 21:22:41.993021 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.992972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" event={"ID":"50439b98-57b8-4ad3-a439-f7687e67f9bf","Type":"ContainerStarted","Data":"71b2de5229806539a45ca4898b2fc123c95e2f8336c4fd5a12b79b9eca54e007"} Jun 05 21:22:41.994390 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:41.994370 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"81961aaa294f1f321950b8241d7b03b3c4d224c58d13bc71a77ebc5d5b947d4a"} Jun 05 21:22:42.011177 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:42.011121 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" podStartSLOduration=1.156674178 podStartE2EDuration="3.0111052s" totalImagesPullingTime="1.854431022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:42.010539682 +0000 UTC m=+245.247328906" watchObservedRunningTime="2026-06-05 21:22:42.0111052 +0000 UTC m=+245.247894397" Jun 05 21:22:43.000902 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:43.000803 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} Jun 05 21:22:44.006527 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:44.006488 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" exitCode=0 Jun 05 21:22:44.007011 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:44.006577 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} Jun 05 21:22:44.008446 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:44.008360 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" event={"ID":"0385f27d-f89a-4442-9160-a434eed39a2f","Type":"ContainerStarted","Data":"73d03dc4c69f1db9eca6e493cd89aec3a45960e40fa3705021bbbdcfad7017a1"} Jun 05 21:22:44.008546 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:44.008527 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:44.014540 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:44.014519 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" Jun 05 21:22:44.045715 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:44.045642 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gqtpp" podStartSLOduration=3.5014858909999997 podStartE2EDuration="5.045622554s" totalImagesPullingTime="1.544136663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:44.045563038 +0000 UTC m=+247.282352238" watchObservedRunningTime="2026-06-05 21:22:44.045622554 +0000 UTC m=+247.282411770" Jun 05 21:22:46.220689 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:46.220567 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" podUID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" containerName="registry" containerID="cri-o://c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5" gracePeriod=30 Jun 05 21:22:47.003532 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.003500 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d755cc74f-kcnq4" Jun 05 21:22:47.475343 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.475318 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.531965 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-installation-pull-secrets\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.532006 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.532026 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-bound-sa-token\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.532053 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twc5x\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-kube-api-access-twc5x\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.532090 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-ca-trust-extracted\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.532109 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-certificates\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.532136 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-trusted-ca\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.532572 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.532179 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-image-registry-private-configuration\") pod \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\" (UID: \"764d6a11-a12f-4d21-a9d0-c69fbb603c3a\") " Jun 05 21:22:47.533726 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.533688 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:22:47.534133 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.534082 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:22:47.535093 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.535065 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:22:47.535271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.535250 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-kube-api-access-twc5x" (OuterVolumeSpecName: "kube-api-access-twc5x") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "kube-api-access-twc5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:22:47.535665 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.535640 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:22:47.538181 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.538130 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:22:47.538715 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.538684 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:22:47.546554 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.546520 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "764d6a11-a12f-4d21-a9d0-c69fbb603c3a" (UID: "764d6a11-a12f-4d21-a9d0-c69fbb603c3a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.637853 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-image-registry-private-configuration\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.638063 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-installation-pull-secrets\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.638081 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-tls\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.638095 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-bound-sa-token\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.638109 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twc5x\" (UniqueName: \"kubernetes.io/projected/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-kube-api-access-twc5x\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.638268 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-ca-trust-extracted\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.638286 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-registry-certificates\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:47.638897 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:47.638300 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/764d6a11-a12f-4d21-a9d0-c69fbb603c3a-trusted-ca\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:22:48.027795 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.027756 2567 generic.go:356] "Generic (PLEG): container finished" podID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" containerID="c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5" exitCode=0 Jun 05 21:22:48.028000 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.027820 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" Jun 05 21:22:48.028000 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.027840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" event={"ID":"764d6a11-a12f-4d21-a9d0-c69fbb603c3a","Type":"ContainerDied","Data":"c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5"} Jun 05 21:22:48.028000 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.027942 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6744f8c88d-cmpzq" event={"ID":"764d6a11-a12f-4d21-a9d0-c69fbb603c3a","Type":"ContainerDied","Data":"f192c582f78acf273ff4826c8d19390e5264facf67c474d44c650f4bc6eb6e3a"} Jun 05 21:22:48.028000 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.027970 2567 scope.go:117] "RemoveContainer" containerID="c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5" Jun 05 21:22:48.032179 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.032153 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} Jun 05 21:22:48.032306 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.032226 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} Jun 05 21:22:48.032306 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.032278 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} Jun 05 21:22:48.032421 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.032318 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} Jun 05 21:22:48.032421 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.032365 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} Jun 05 21:22:48.032421 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.032405 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerStarted","Data":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} Jun 05 21:22:48.040973 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.040953 2567 scope.go:117] "RemoveContainer" containerID="c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5" Jun 05 21:22:48.041260 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:22:48.041233 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5\": container with ID starting with c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5 not found: ID does not exist" containerID="c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5" Jun 05 21:22:48.041336 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.041272 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5"} err="failed to get container status \"c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5\": rpc error: code = NotFound desc = could not find container \"c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5\": container with ID starting with c59ccee0f0ae97f7aad0c668f968275044092142e94fb57a57bf3f6f80a40ac5 not found: ID does not exist" Jun 05 21:22:48.061113 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.060719 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.651338602 podStartE2EDuration="7.060698958s" totalImagesPullingTime="4.382336969s" totalInitContainerRuntime="27.023387ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:48.059442915 +0000 UTC m=+251.296232114" watchObservedRunningTime="2026-06-05 21:22:48.060698958 +0000 UTC m=+251.297488157" Jun 05 21:22:48.071197 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.071159 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6744f8c88d-cmpzq"] Jun 05 21:22:48.074720 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.074695 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6744f8c88d-cmpzq"] Jun 05 21:22:48.950963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.950928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:22:48.953406 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:48.953379 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a279011-45a7-449c-9754-a20d1c0d3f00-metrics-certs\") pod \"network-metrics-daemon-fbkgz\" (UID: \"0a279011-45a7-449c-9754-a20d1c0d3f00\") " pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:22:49.197362 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:49.197330 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6kmjr\"" Jun 05 21:22:49.198282 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:49.198251 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" path="/var/lib/kubelet/pods/764d6a11-a12f-4d21-a9d0-c69fbb603c3a/volumes" Jun 05 21:22:49.205915 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:49.205835 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbkgz" Jun 05 21:22:49.348901 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:49.348833 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbkgz"] Jun 05 21:22:51.423895 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:51.423835 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:22:56.160022 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:22:56.159993 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a279011_45a7_449c_9754_a20d1c0d3f00.slice/crio-3108dd6b03a3d70fd37fd2f89bebb085504c661f0711d2075293c63e790958e2 WatchSource:0}: Error finding container 3108dd6b03a3d70fd37fd2f89bebb085504c661f0711d2075293c63e790958e2: Status 404 returned error can't find the container with id 3108dd6b03a3d70fd37fd2f89bebb085504c661f0711d2075293c63e790958e2 Jun 05 21:22:57.072536 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:57.072353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-x58hc" event={"ID":"611e9f75-b10e-4cf3-a84c-a74af9d7996b","Type":"ContainerStarted","Data":"bb6c7bd9ce3c9c5348acd6ee7ce31449adfff6475ec9cdee029c41f2b58714cf"} Jun 05 21:22:57.073117 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:57.073088 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-x58hc" Jun 05 21:22:57.074161 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:57.074085 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbkgz" event={"ID":"0a279011-45a7-449c-9754-a20d1c0d3f00","Type":"ContainerStarted","Data":"3108dd6b03a3d70fd37fd2f89bebb085504c661f0711d2075293c63e790958e2"} Jun 05 21:22:57.086662 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:57.086639 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-x58hc" Jun 05 21:22:57.089506 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:57.089451 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-x58hc" podStartSLOduration=2.060276899 podStartE2EDuration="19.08943095s" totalImagesPullingTime="17.029154051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:57.087732157 +0000 UTC m=+260.324521380" watchObservedRunningTime="2026-06-05 21:22:57.08943095 +0000 UTC m=+260.326220148" Jun 05 21:22:58.081871 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:58.081296 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbkgz" event={"ID":"0a279011-45a7-449c-9754-a20d1c0d3f00","Type":"ContainerStarted","Data":"d372c4d2cb9ed27f3617b650b667eb0015791afb5ff3e3b36924a74d620f23f4"} Jun 05 21:22:58.081871 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:58.081377 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbkgz" event={"ID":"0a279011-45a7-449c-9754-a20d1c0d3f00","Type":"ContainerStarted","Data":"a07ee7fc66472ca85835d123a7211a22eeaa60c7c5b18134835052dbc0cf5113"} Jun 05 21:22:58.100132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:58.100063 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbkgz" podStartSLOduration=260.035016817 podStartE2EDuration="4m21.100043371s" totalImagesPullingTime="1.065026554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:58.098347843 +0000 UTC m=+261.335137069" watchObservedRunningTime="2026-06-05 21:22:58.100043371 +0000 UTC m=+261.336832568" Jun 05 21:22:59.608672 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:59.608634 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:22:59.609138 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:22:59.608703 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:23:12.828110 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:12.828080 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xdf72_dbfc8003-7513-4157-9e67-1954dd63fec2/cluster-monitoring-operator/0.log" Jun 05 21:23:13.627025 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:13.626986 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c44f44476-j26qp_50439b98-57b8-4ad3-a439-f7687e67f9bf/metrics-server/0.log" Jun 05 21:23:13.826886 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:13.826857 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-gqtpp_0385f27d-f89a-4442-9160-a434eed39a2f/monitoring-plugin/0.log" Jun 05 21:23:14.626509 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:14.626479 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ddhz_a744b16b-dfc3-4408-b562-ea3787d4adba/init-textfile/0.log" Jun 05 21:23:14.828072 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:14.828040 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ddhz_a744b16b-dfc3-4408-b562-ea3787d4adba/node-exporter/0.log" Jun 05 21:23:15.026015 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:15.025992 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ddhz_a744b16b-dfc3-4408-b562-ea3787d4adba/kube-rbac-proxy/0.log" Jun 05 21:23:16.427435 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:16.427404 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c44dc24-1540-4d9b-9a2a-4411392ec0ae/init-config-reloader/0.log" Jun 05 21:23:16.629206 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:16.629172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c44dc24-1540-4d9b-9a2a-4411392ec0ae/prometheus/0.log" Jun 05 21:23:16.834458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:16.834431 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c44dc24-1540-4d9b-9a2a-4411392ec0ae/config-reloader/0.log" Jun 05 21:23:17.027511 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:17.027478 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c44dc24-1540-4d9b-9a2a-4411392ec0ae/thanos-sidecar/0.log" Jun 05 21:23:17.227169 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:17.227101 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c44dc24-1540-4d9b-9a2a-4411392ec0ae/kube-rbac-proxy-web/0.log" Jun 05 21:23:17.426726 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:17.426688 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c44dc24-1540-4d9b-9a2a-4411392ec0ae/kube-rbac-proxy/0.log" Jun 05 21:23:17.627705 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:17.627672 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3c44dc24-1540-4d9b-9a2a-4411392ec0ae/kube-rbac-proxy-thanos/0.log" Jun 05 21:23:17.695820 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:23:17.695771 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dlh9x" podUID="51b1c7e8-5203-44d8-855c-59832720b4dd" Jun 05 21:23:18.159315 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:18.159278 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlh9x" Jun 05 21:23:18.427734 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:18.427666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/thanos-query/0.log" Jun 05 21:23:18.627590 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:18.627560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy-web/0.log" Jun 05 21:23:18.826126 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:18.826095 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy/0.log" Jun 05 21:23:19.026801 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:19.026775 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/prom-label-proxy/0.log" Jun 05 21:23:19.227216 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:19.227144 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy-rules/0.log" Jun 05 21:23:19.426508 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:19.426480 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy-metrics/0.log" Jun 05 21:23:19.613178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:19.613146 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:23:19.616974 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:19.616947 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c44f44476-j26qp" Jun 05 21:23:19.827534 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:19.827503 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:23:20.028466 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:20.028440 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/3.log" Jun 05 21:23:20.627399 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:20.627370 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-x58hc_611e9f75-b10e-4cf3-a84c-a74af9d7996b/download-server/0.log" Jun 05 21:23:21.647421 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:21.647383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:23:21.649710 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:21.649683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51b1c7e8-5203-44d8-855c-59832720b4dd-metrics-tls\") pod \"dns-default-dlh9x\" (UID: \"51b1c7e8-5203-44d8-855c-59832720b4dd\") " pod="openshift-dns/dns-default-dlh9x" Jun 05 21:23:21.762405 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:21.762374 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6hvj9\"" Jun 05 21:23:21.771514 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:21.771488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlh9x" Jun 05 21:23:21.898173 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:21.898150 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dlh9x"] Jun 05 21:23:21.900673 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:23:21.900639 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b1c7e8_5203_44d8_855c_59832720b4dd.slice/crio-0683d7ea365367977062194701f53193a3ce1e4a35518b16bd9194453fc08157 WatchSource:0}: Error finding container 0683d7ea365367977062194701f53193a3ce1e4a35518b16bd9194453fc08157: Status 404 returned error can't find the container with id 0683d7ea365367977062194701f53193a3ce1e4a35518b16bd9194453fc08157 Jun 05 21:23:22.026848 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:22.026821 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8zxjn_3b207abd-2216-45ce-84fe-1f49a8c0b49c/dns-node-resolver/0.log" Jun 05 21:23:22.175832 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:22.175750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlh9x" event={"ID":"51b1c7e8-5203-44d8-855c-59832720b4dd","Type":"ContainerStarted","Data":"0683d7ea365367977062194701f53193a3ce1e4a35518b16bd9194453fc08157"} Jun 05 21:23:23.426719 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:23.426694 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rd274_e35c1474-69c4-4617-aeba-eef3e7b9a3a9/node-ca/0.log" Jun 05 21:23:24.026748 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:24.026722 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghwzl_b9f552dd-786d-49ac-b51b-5987fc28c830/serve-healthcheck-canary/0.log" Jun 05 21:23:24.186517 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:24.186480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlh9x" event={"ID":"51b1c7e8-5203-44d8-855c-59832720b4dd","Type":"ContainerStarted","Data":"e960e3ae63d5947917d5a23319aa70a700c1029df7ebc97e6575cc34a1a195ee"} Jun 05 21:23:24.186681 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:24.186530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlh9x" event={"ID":"51b1c7e8-5203-44d8-855c-59832720b4dd","Type":"ContainerStarted","Data":"93f86c4cda7acf2766b4520af19b4db752fe2fe2975c17125d70b2bbe58dfc8c"} Jun 05 21:23:24.186681 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:24.186561 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dlh9x" Jun 05 21:23:24.204195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:24.204144 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dlh9x" podStartSLOduration=251.836554798 podStartE2EDuration="4m13.204128056s" totalImagesPullingTime="1.367573258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:23:24.202427769 +0000 UTC m=+287.439216986" watchObservedRunningTime="2026-06-05 21:23:24.204128056 +0000 UTC m=+287.440917253" Jun 05 21:23:34.193308 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:34.193279 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dlh9x" Jun 05 21:23:37.131095 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:37.131069 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:23:37.133906 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:37.133865 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:23:37.145323 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:37.145298 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 21:23:41.423555 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:41.423517 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:23:41.493716 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:41.493689 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:23:42.272729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:42.272700 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:23:59.541545 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.541512 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:23:59.542079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.541779 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="prometheus" containerID="cri-o://d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" gracePeriod=600 Jun 05 21:23:59.542079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.541829 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy" containerID="cri-o://8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" gracePeriod=600 Jun 05 21:23:59.542079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.541859 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" gracePeriod=600 Jun 05 21:23:59.542079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.541892 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="thanos-sidecar" containerID="cri-o://9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" gracePeriod=600 Jun 05 21:23:59.542079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.541918 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="config-reloader" containerID="cri-o://38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" gracePeriod=600 Jun 05 21:23:59.542079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.541913 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-web" containerID="cri-o://afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" gracePeriod=600 Jun 05 21:23:59.789376 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.789352 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:23:59.882618 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882533 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.882618 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882570 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-kube-rbac-proxy\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.882618 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882595 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-trusted-ca-bundle\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.882869 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882624 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54p4s\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-kube-api-access-54p4s\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.882869 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882658 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.882869 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882682 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-0\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.882869 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882707 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-db\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.882869 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.882733 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-grpc-tls\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883157 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883102 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:59.883225 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883162 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-tls-assets\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883225 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883197 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config-out\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883342 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883230 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-2\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883342 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883276 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-serving-certs-ca-bundle\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883342 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883306 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-1\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883342 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883335 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-metrics-client-ca\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883537 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883361 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883537 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883392 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-kubelet-serving-ca-bundle\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883537 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883463 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-web-config\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883537 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883502 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-thanos-prometheus-http-client-file\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883537 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883534 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-metrics-client-certs\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.883781 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.883569 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-tls\") pod \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\" (UID: \"3c44dc24-1540-4d9b-9a2a-4411392ec0ae\") " Jun 05 21:23:59.884256 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.884226 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:59.884373 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.884235 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:59.885149 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.884674 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:59.885149 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885129 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:59.885304 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885213 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:23:59.885365 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885314 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:59.885476 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885446 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.885780 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885746 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.885780 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885772 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.885956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885788 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.885956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885801 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-db\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.885956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885815 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.885956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885828 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.885956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885840 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.885956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.885854 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-metrics-client-ca\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.886263 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.886011 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:59.886263 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.886095 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-kube-api-access-54p4s" (OuterVolumeSpecName: "kube-api-access-54p4s") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "kube-api-access-54p4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:23:59.886263 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.886151 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.886610 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.886587 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.886794 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.886770 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:23:59.887100 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.887080 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config-out" (OuterVolumeSpecName: "config-out") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:23:59.887676 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.887654 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config" (OuterVolumeSpecName: "config") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.887798 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.887783 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.888153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.888133 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.888415 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.888397 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.888499 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.888474 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.897885 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.897853 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-web-config" (OuterVolumeSpecName: "web-config") pod "3c44dc24-1540-4d9b-9a2a-4411392ec0ae" (UID: "3c44dc24-1540-4d9b-9a2a-4411392ec0ae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:59.986698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986662 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-kube-rbac-proxy\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986692 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54p4s\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-kube-api-access-54p4s\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986705 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986719 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-grpc-tls\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986731 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-tls-assets\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986741 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-config-out\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986753 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986764 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986778 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-web-config\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986790 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986802 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-metrics-client-certs\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:23:59.986976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:23:59.986813 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c44dc24-1540-4d9b-9a2a-4411392ec0ae-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:24:00.326892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326817 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" exitCode=0 Jun 05 21:24:00.326892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326844 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" exitCode=0 Jun 05 21:24:00.326892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326850 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" exitCode=0 Jun 05 21:24:00.326892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326856 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" exitCode=0 Jun 05 21:24:00.326892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326863 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" exitCode=0 Jun 05 21:24:00.326892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326869 2567 generic.go:356] "Generic (PLEG): container finished" podID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" exitCode=0 Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326899 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326902 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.326984 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.327026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.327048 2567 scope.go:117] "RemoveContainer" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.327061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.327103 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.327139 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} Jun 05 21:24:00.327425 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.327181 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c44dc24-1540-4d9b-9a2a-4411392ec0ae","Type":"ContainerDied","Data":"81961aaa294f1f321950b8241d7b03b3c4d224c58d13bc71a77ebc5d5b947d4a"} Jun 05 21:24:00.334820 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.334803 2567 scope.go:117] "RemoveContainer" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.342038 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.342019 2567 scope.go:117] "RemoveContainer" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.348640 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.348620 2567 scope.go:117] "RemoveContainer" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.356844 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.353222 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:24:00.360483 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.360459 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:24:00.360754 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.360738 2567 scope.go:117] "RemoveContainer" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.367382 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.367367 2567 scope.go:117] "RemoveContainer" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.374595 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.374575 2567 scope.go:117] "RemoveContainer" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.381376 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.381359 2567 scope.go:117] "RemoveContainer" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.381637 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:24:00.381615 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": container with ID starting with 8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d not found: ID does not exist" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.381716 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.381643 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} err="failed to get container status \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": rpc error: code = NotFound desc = could not find container \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": container with ID starting with 8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d not found: ID does not exist" Jun 05 21:24:00.381716 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.381663 2567 scope.go:117] "RemoveContainer" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.381976 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:24:00.381951 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": container with ID starting with 8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783 not found: ID does not exist" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.382031 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.381984 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} err="failed to get container status \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": rpc error: code = NotFound desc = could not find container \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": container with ID starting with 8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783 not found: ID does not exist" Jun 05 21:24:00.382031 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382004 2567 scope.go:117] "RemoveContainer" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.382260 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:24:00.382242 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": container with ID starting with afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a not found: ID does not exist" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.382316 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382269 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} err="failed to get container status \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": rpc error: code = NotFound desc = could not find container \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": container with ID starting with afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a not found: ID does not exist" Jun 05 21:24:00.382316 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382287 2567 scope.go:117] "RemoveContainer" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.382488 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:24:00.382474 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": container with ID starting with 9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828 not found: ID does not exist" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.382528 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382491 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} err="failed to get container status \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": rpc error: code = NotFound desc = could not find container \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": container with ID starting with 9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828 not found: ID does not exist" Jun 05 21:24:00.382528 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382503 2567 scope.go:117] "RemoveContainer" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.382720 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:24:00.382705 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": container with ID starting with 38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723 not found: ID does not exist" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.382768 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382723 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} err="failed to get container status \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": rpc error: code = NotFound desc = could not find container \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": container with ID starting with 38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723 not found: ID does not exist" Jun 05 21:24:00.382768 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382735 2567 scope.go:117] "RemoveContainer" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.382940 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:24:00.382925 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": container with ID starting with d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd not found: ID does not exist" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.382984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382944 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} err="failed to get container status \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": rpc error: code = NotFound desc = could not find container \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": container with ID starting with d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd not found: ID does not exist" Jun 05 21:24:00.382984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.382956 2567 scope.go:117] "RemoveContainer" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.383178 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:24:00.383164 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": container with ID starting with ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337 not found: ID does not exist" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.383227 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383179 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} err="failed to get container status \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": rpc error: code = NotFound desc = could not find container \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": container with ID starting with ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337 not found: ID does not exist" Jun 05 21:24:00.383227 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383198 2567 scope.go:117] "RemoveContainer" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.383428 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383413 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} err="failed to get container status \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": rpc error: code = NotFound desc = could not find container \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": container with ID starting with 8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d not found: ID does not exist" Jun 05 21:24:00.383465 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383427 2567 scope.go:117] "RemoveContainer" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.383619 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383604 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} err="failed to get container status \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": rpc error: code = NotFound desc = could not find container \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": container with ID starting with 8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783 not found: ID does not exist" Jun 05 21:24:00.383619 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383619 2567 scope.go:117] "RemoveContainer" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.383831 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383812 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} err="failed to get container status \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": rpc error: code = NotFound desc = could not find container \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": container with ID starting with afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a not found: ID does not exist" Jun 05 21:24:00.383898 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.383833 2567 scope.go:117] "RemoveContainer" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.384086 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384059 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} err="failed to get container status \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": rpc error: code = NotFound desc = could not find container \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": container with ID starting with 9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828 not found: ID does not exist" Jun 05 21:24:00.384086 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384085 2567 scope.go:117] "RemoveContainer" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.384280 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384265 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} err="failed to get container status \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": rpc error: code = NotFound desc = could not find container \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": container with ID starting with 38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723 not found: ID does not exist" Jun 05 21:24:00.384321 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384281 2567 scope.go:117] "RemoveContainer" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.384477 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384462 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} err="failed to get container status \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": rpc error: code = NotFound desc = could not find container \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": container with ID starting with d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd not found: ID does not exist" Jun 05 21:24:00.384477 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384476 2567 scope.go:117] "RemoveContainer" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.384659 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384639 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} err="failed to get container status \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": rpc error: code = NotFound desc = could not find container \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": container with ID starting with ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337 not found: ID does not exist" Jun 05 21:24:00.384700 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384660 2567 scope.go:117] "RemoveContainer" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.384894 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384858 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} err="failed to get container status \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": rpc error: code = NotFound desc = could not find container \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": container with ID starting with 8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d not found: ID does not exist" Jun 05 21:24:00.384894 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.384884 2567 scope.go:117] "RemoveContainer" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.385094 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385075 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} err="failed to get container status \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": rpc error: code = NotFound desc = could not find container \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": container with ID starting with 8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783 not found: ID does not exist" Jun 05 21:24:00.385132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385094 2567 scope.go:117] "RemoveContainer" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.385297 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385275 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} err="failed to get container status \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": rpc error: code = NotFound desc = could not find container \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": container with ID starting with afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a not found: ID does not exist" Jun 05 21:24:00.385401 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385298 2567 scope.go:117] "RemoveContainer" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.385507 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385493 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} err="failed to get container status \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": rpc error: code = NotFound desc = could not find container \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": container with ID starting with 9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828 not found: ID does not exist" Jun 05 21:24:00.385551 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385507 2567 scope.go:117] "RemoveContainer" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.385708 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385689 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} err="failed to get container status \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": rpc error: code = NotFound desc = could not find container \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": container with ID starting with 38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723 not found: ID does not exist" Jun 05 21:24:00.385778 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385709 2567 scope.go:117] "RemoveContainer" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.385931 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385914 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} err="failed to get container status \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": rpc error: code = NotFound desc = could not find container \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": container with ID starting with d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd not found: ID does not exist" Jun 05 21:24:00.385999 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.385932 2567 scope.go:117] "RemoveContainer" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.386141 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.386125 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} err="failed to get container status \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": rpc error: code = NotFound desc = could not find container \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": container with ID starting with ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337 not found: ID does not exist" Jun 05 21:24:00.386202 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.386142 2567 scope.go:117] "RemoveContainer" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.386428 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.386405 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} err="failed to get container status \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": rpc error: code = NotFound desc = could not find container \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": container with ID starting with 8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d not found: ID does not exist" Jun 05 21:24:00.386499 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.386431 2567 scope.go:117] "RemoveContainer" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.386693 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.386670 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} err="failed to get container status \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": rpc error: code = NotFound desc = could not find container \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": container with ID starting with 8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783 not found: ID does not exist" Jun 05 21:24:00.386693 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.386691 2567 scope.go:117] "RemoveContainer" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.387360 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.387337 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} err="failed to get container status \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": rpc error: code = NotFound desc = could not find container \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": container with ID starting with afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a not found: ID does not exist" Jun 05 21:24:00.387360 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.387359 2567 scope.go:117] "RemoveContainer" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.387612 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.387589 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} err="failed to get container status \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": rpc error: code = NotFound desc = could not find container \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": container with ID starting with 9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828 not found: ID does not exist" Jun 05 21:24:00.387659 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.387615 2567 scope.go:117] "RemoveContainer" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.387867 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.387847 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} err="failed to get container status \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": rpc error: code = NotFound desc = could not find container \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": container with ID starting with 38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723 not found: ID does not exist" Jun 05 21:24:00.387965 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.387868 2567 scope.go:117] "RemoveContainer" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.388113 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388092 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} err="failed to get container status \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": rpc error: code = NotFound desc = could not find container \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": container with ID starting with d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd not found: ID does not exist" Jun 05 21:24:00.388161 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388116 2567 scope.go:117] "RemoveContainer" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.388297 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388281 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:24:00.388359 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388335 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} err="failed to get container status \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": rpc error: code = NotFound desc = could not find container \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": container with ID starting with ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337 not found: ID does not exist" Jun 05 21:24:00.388359 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388353 2567 scope.go:117] "RemoveContainer" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.388592 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388563 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} err="failed to get container status \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": rpc error: code = NotFound desc = could not find container \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": container with ID starting with 8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d not found: ID does not exist" Jun 05 21:24:00.388592 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388591 2567 scope.go:117] "RemoveContainer" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388594 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="config-reloader" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388605 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="config-reloader" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388616 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-thanos" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388622 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-thanos" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388630 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="prometheus" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388635 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="prometheus" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388641 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="thanos-sidecar" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388649 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="thanos-sidecar" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388659 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-web" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388667 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-web" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388681 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" containerName="registry" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388689 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" containerName="registry" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388699 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="init-config-reloader" Jun 05 21:24:00.388698 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388707 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="init-config-reloader" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388722 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388731 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388802 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="prometheus" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388814 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="764d6a11-a12f-4d21-a9d0-c69fbb603c3a" containerName="registry" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388820 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-web" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388826 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388832 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="config-reloader" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388837 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="thanos-sidecar" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388845 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" containerName="kube-rbac-proxy-thanos" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388844 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} err="failed to get container status \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": rpc error: code = NotFound desc = could not find container \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": container with ID starting with 8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783 not found: ID does not exist" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.388861 2567 scope.go:117] "RemoveContainer" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389125 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} err="failed to get container status \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": rpc error: code = NotFound desc = could not find container \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": container with ID starting with afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a not found: ID does not exist" Jun 05 21:24:00.389221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389141 2567 scope.go:117] "RemoveContainer" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.389719 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389381 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} err="failed to get container status \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": rpc error: code = NotFound desc = could not find container \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": container with ID starting with 9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828 not found: ID does not exist" Jun 05 21:24:00.389719 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389397 2567 scope.go:117] "RemoveContainer" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.389719 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389609 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} err="failed to get container status \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": rpc error: code = NotFound desc = could not find container \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": container with ID starting with 38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723 not found: ID does not exist" Jun 05 21:24:00.389719 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389638 2567 scope.go:117] "RemoveContainer" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.389898 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389837 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} err="failed to get container status \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": rpc error: code = NotFound desc = could not find container \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": container with ID starting with d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd not found: ID does not exist" Jun 05 21:24:00.389898 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.389851 2567 scope.go:117] "RemoveContainer" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.390110 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390089 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} err="failed to get container status \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": rpc error: code = NotFound desc = could not find container \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": container with ID starting with ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337 not found: ID does not exist" Jun 05 21:24:00.390160 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390111 2567 scope.go:117] "RemoveContainer" containerID="8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d" Jun 05 21:24:00.390320 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390300 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d"} err="failed to get container status \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": rpc error: code = NotFound desc = could not find container \"8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d\": container with ID starting with 8a633fa06ac56c0a25c896d1b127c5c7a3d6a728f692d619fafbd84278703c3d not found: ID does not exist" Jun 05 21:24:00.390384 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390322 2567 scope.go:117] "RemoveContainer" containerID="8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783" Jun 05 21:24:00.390543 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390526 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783"} err="failed to get container status \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": rpc error: code = NotFound desc = could not find container \"8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783\": container with ID starting with 8b1b3b3bf03acd480af9e550f0d8d836cf70a1de34c9c88d20ac7b8206efb783 not found: ID does not exist" Jun 05 21:24:00.390543 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390543 2567 scope.go:117] "RemoveContainer" containerID="afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a" Jun 05 21:24:00.390733 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390716 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a"} err="failed to get container status \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": rpc error: code = NotFound desc = could not find container \"afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a\": container with ID starting with afff354bc946492149deefcff58163b76a9b462c4f8bfc4c90b3fb912bf55b9a not found: ID does not exist" Jun 05 21:24:00.390793 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390734 2567 scope.go:117] "RemoveContainer" containerID="9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828" Jun 05 21:24:00.390937 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390921 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828"} err="failed to get container status \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": rpc error: code = NotFound desc = could not find container \"9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828\": container with ID starting with 9f655dde02130ee9ec2614762d72de3ac8bf005b3febabc08e29de6975cc1828 not found: ID does not exist" Jun 05 21:24:00.391008 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.390938 2567 scope.go:117] "RemoveContainer" containerID="38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723" Jun 05 21:24:00.391153 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.391134 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723"} err="failed to get container status \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": rpc error: code = NotFound desc = could not find container \"38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723\": container with ID starting with 38ff5d2d1468529ac05434b3429f63803980906edaa9cb84595b357117ecd723 not found: ID does not exist" Jun 05 21:24:00.391202 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.391154 2567 scope.go:117] "RemoveContainer" containerID="d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd" Jun 05 21:24:00.391370 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.391352 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd"} err="failed to get container status \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": rpc error: code = NotFound desc = could not find container \"d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd\": container with ID starting with d86f394c9709f2d8d4ebdd73ccaf6a1add1ce9241f73af421d09f0f94c2d8dcd not found: ID does not exist" Jun 05 21:24:00.391411 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.391371 2567 scope.go:117] "RemoveContainer" containerID="ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337" Jun 05 21:24:00.391579 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.391563 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337"} err="failed to get container status \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": rpc error: code = NotFound desc = could not find container \"ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337\": container with ID starting with ee08367cf8ac9d29bd3c3b893ba7d22308e3225ff2bada34c41e7e6e4c864337 not found: ID does not exist" Jun 05 21:24:00.392910 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.392896 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.395079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395059 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 21:24:00.395169 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395059 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 21:24:00.395217 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395166 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 21:24:00.395274 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395202 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 21:24:00.395336 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395320 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 21:24:00.395383 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395366 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5shfs\"" Jun 05 21:24:00.395427 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395412 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 21:24:00.395464 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395439 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 21:24:00.395521 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395507 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 21:24:00.395831 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395819 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 21:24:00.395980 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.395963 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ldu6ssdji9uj\"" Jun 05 21:24:00.396309 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.396293 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 21:24:00.396664 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.396651 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 21:24:00.397448 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.397431 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 21:24:00.399402 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.399384 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 21:24:00.402630 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.402612 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 21:24:00.410318 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.410299 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:24:00.490452 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490452 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490456 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e47216c4-12b3-4fc7-ac21-2c77753f3335-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e47216c4-12b3-4fc7-ac21-2c77753f3335-config-out\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.490729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-web-config\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490762 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2thcg\" (UniqueName: \"kubernetes.io/projected/e47216c4-12b3-4fc7-ac21-2c77753f3335-kube-api-access-2thcg\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.490991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.491023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.491052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.491132 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.491083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-config\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.591914 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.591809 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.591914 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.591845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.591914 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.591870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-config\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592061 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e47216c4-12b3-4fc7-ac21-2c77753f3335-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e47216c4-12b3-4fc7-ac21-2c77753f3335-config-out\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-web-config\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2thcg\" (UniqueName: \"kubernetes.io/projected/e47216c4-12b3-4fc7-ac21-2c77753f3335-kube-api-access-2thcg\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.592458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592441 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.593188 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.593188 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.593188 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.593188 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.592781 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.593188 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.593080 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.593483 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.593451 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.595354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.594361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.595354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.594862 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.595354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.595099 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.595596 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.595574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.595596 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.595580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.595807 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.595782 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-config\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.595963 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.595918 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e47216c4-12b3-4fc7-ac21-2c77753f3335-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.596106 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.596081 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.596217 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.596191 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.597203 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.597177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.597471 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.597450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e47216c4-12b3-4fc7-ac21-2c77753f3335-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.597713 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.597692 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e47216c4-12b3-4fc7-ac21-2c77753f3335-config-out\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.597780 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.597717 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.598307 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.598286 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.598468 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.598450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e47216c4-12b3-4fc7-ac21-2c77753f3335-web-config\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.602417 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.602398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2thcg\" (UniqueName: \"kubernetes.io/projected/e47216c4-12b3-4fc7-ac21-2c77753f3335-kube-api-access-2thcg\") pod \"prometheus-k8s-0\" (UID: \"e47216c4-12b3-4fc7-ac21-2c77753f3335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.702891 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.702851 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:24:00.838488 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:00.838456 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:24:00.842520 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:24:00.842467 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47216c4_12b3_4fc7_ac21_2c77753f3335.slice/crio-1accde7e4d5b39bcab85ff75b26dd105a976bd19a83250dcb2659c0fb2e5f15a WatchSource:0}: Error finding container 1accde7e4d5b39bcab85ff75b26dd105a976bd19a83250dcb2659c0fb2e5f15a: Status 404 returned error can't find the container with id 1accde7e4d5b39bcab85ff75b26dd105a976bd19a83250dcb2659c0fb2e5f15a Jun 05 21:24:01.196370 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:01.196292 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c44dc24-1540-4d9b-9a2a-4411392ec0ae" path="/var/lib/kubelet/pods/3c44dc24-1540-4d9b-9a2a-4411392ec0ae/volumes" Jun 05 21:24:01.332764 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:01.332728 2567 generic.go:356] "Generic (PLEG): container finished" podID="e47216c4-12b3-4fc7-ac21-2c77753f3335" containerID="42804c842af2d8a917bc4cf7372b16b28da9a2b9274999fe3f0c457ba0700988" exitCode=0 Jun 05 21:24:01.332942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:01.332814 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerDied","Data":"42804c842af2d8a917bc4cf7372b16b28da9a2b9274999fe3f0c457ba0700988"} Jun 05 21:24:01.332942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:01.332909 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerStarted","Data":"1accde7e4d5b39bcab85ff75b26dd105a976bd19a83250dcb2659c0fb2e5f15a"} Jun 05 21:24:02.341906 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:02.341853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerStarted","Data":"b05b21c3805f86cd8fd0aca119615d85d93b838b8f666c3de6a6195c53bef264"} Jun 05 21:24:02.342357 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:02.341941 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerStarted","Data":"1347d23bb2983cdd7a6fa77dcaff0ed726306fd853585f2a57a04f8937cda04d"} Jun 05 21:24:02.342357 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:02.341968 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerStarted","Data":"d74c33a1ba13fe91f7d095079e21dc48f7c3e59b487d7e1f0e4d739b44dcced5"} Jun 05 21:24:02.342357 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:02.341997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerStarted","Data":"fd6d2bb42d07904aa81ddc64589cb4952f8ab5d4562012213699beed025d7502"} Jun 05 21:24:02.342357 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:02.342023 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerStarted","Data":"5ef73202f6305edd98c3d39786ecdeea018864e6a6141f53fdaeb46ff4b5dbec"} Jun 05 21:24:02.342357 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:02.342045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e47216c4-12b3-4fc7-ac21-2c77753f3335","Type":"ContainerStarted","Data":"3e64d2451f8970ee1d04bea6ba1f7752853f1b294095760a2134b7b917a916e2"} Jun 05 21:24:02.374455 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:02.374389 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.35230824 podStartE2EDuration="2.374363973s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.055733ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:24:02.373055189 +0000 UTC m=+325.609844405" watchObservedRunningTime="2026-06-05 21:24:02.374363973 +0000 UTC m=+325.611153212" Jun 05 21:24:05.703446 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:24:05.703410 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:25:00.703288 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:25:00.703242 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:25:00.718326 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:25:00.718302 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:25:01.577842 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:25:01.577811 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:28:37.160451 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:28:37.160415 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:28:37.162237 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:28:37.162218 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:30:26.890140 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:26.890064 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4"] Jun 05 21:30:26.893226 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:26.893210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:26.895378 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:26.895355 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 21:30:26.895521 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:26.895362 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 21:30:26.895521 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:26.895435 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qzbcs\"" Jun 05 21:30:26.903671 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:26.903648 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4"] Jun 05 21:30:27.002212 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.002179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d48969f-1b68-4293-a77e-035f6494c7c3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-hr8c4\" (UID: \"5d48969f-1b68-4293-a77e-035f6494c7c3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:27.002383 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.002218 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sqt2\" (UniqueName: \"kubernetes.io/projected/5d48969f-1b68-4293-a77e-035f6494c7c3-kube-api-access-6sqt2\") pod \"cert-manager-cainjector-5d99449ffd-hr8c4\" (UID: \"5d48969f-1b68-4293-a77e-035f6494c7c3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:27.103228 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.103184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d48969f-1b68-4293-a77e-035f6494c7c3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-hr8c4\" (UID: \"5d48969f-1b68-4293-a77e-035f6494c7c3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:27.103432 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.103243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sqt2\" (UniqueName: \"kubernetes.io/projected/5d48969f-1b68-4293-a77e-035f6494c7c3-kube-api-access-6sqt2\") pod \"cert-manager-cainjector-5d99449ffd-hr8c4\" (UID: \"5d48969f-1b68-4293-a77e-035f6494c7c3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:27.113029 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.112995 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d48969f-1b68-4293-a77e-035f6494c7c3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-hr8c4\" (UID: \"5d48969f-1b68-4293-a77e-035f6494c7c3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:27.113138 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.113076 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sqt2\" (UniqueName: \"kubernetes.io/projected/5d48969f-1b68-4293-a77e-035f6494c7c3-kube-api-access-6sqt2\") pod \"cert-manager-cainjector-5d99449ffd-hr8c4\" (UID: \"5d48969f-1b68-4293-a77e-035f6494c7c3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:27.212890 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.212801 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" Jun 05 21:30:27.341018 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.340992 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4"] Jun 05 21:30:27.344338 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:30:27.344307 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d48969f_1b68_4293_a77e_035f6494c7c3.slice/crio-b0699571587f3ecb854ce7617928212f9ccc77258868ff727de840106852c245 WatchSource:0}: Error finding container b0699571587f3ecb854ce7617928212f9ccc77258868ff727de840106852c245: Status 404 returned error can't find the container with id b0699571587f3ecb854ce7617928212f9ccc77258868ff727de840106852c245 Jun 05 21:30:27.346318 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.346302 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:30:27.759764 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:27.759729 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" event={"ID":"5d48969f-1b68-4293-a77e-035f6494c7c3","Type":"ContainerStarted","Data":"b0699571587f3ecb854ce7617928212f9ccc77258868ff727de840106852c245"} Jun 05 21:30:30.773789 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:30.773751 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" event={"ID":"5d48969f-1b68-4293-a77e-035f6494c7c3","Type":"ContainerStarted","Data":"168f341e857338dd5b91b2d550a8467aabd153fc3dbb67d27841762d5baf89fb"} Jun 05 21:30:30.787962 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:30.787918 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-hr8c4" podStartSLOduration=1.94904404 podStartE2EDuration="4.787902082s" totalImagesPullingTime="2.838858042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:30:30.787387309 +0000 UTC m=+714.024176508" watchObservedRunningTime="2026-06-05 21:30:30.787902082 +0000 UTC m=+714.024691279" Jun 05 21:30:43.822551 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:43.822519 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-qq5hv"] Jun 05 21:30:43.825814 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:43.825787 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:43.827976 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:43.827953 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q8qdv\"" Jun 05 21:30:43.835023 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:43.835000 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-qq5hv"] Jun 05 21:30:43.955803 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:43.955770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28l7g\" (UniqueName: \"kubernetes.io/projected/6d802a43-8008-4ebb-91df-efd9da4b3eb1-kube-api-access-28l7g\") pod \"cert-manager-59c77684cc-qq5hv\" (UID: \"6d802a43-8008-4ebb-91df-efd9da4b3eb1\") " pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:43.956007 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:43.955820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d802a43-8008-4ebb-91df-efd9da4b3eb1-bound-sa-token\") pod \"cert-manager-59c77684cc-qq5hv\" (UID: \"6d802a43-8008-4ebb-91df-efd9da4b3eb1\") " pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:44.056461 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.056424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28l7g\" (UniqueName: \"kubernetes.io/projected/6d802a43-8008-4ebb-91df-efd9da4b3eb1-kube-api-access-28l7g\") pod \"cert-manager-59c77684cc-qq5hv\" (UID: \"6d802a43-8008-4ebb-91df-efd9da4b3eb1\") " pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:44.056654 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.056487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d802a43-8008-4ebb-91df-efd9da4b3eb1-bound-sa-token\") pod \"cert-manager-59c77684cc-qq5hv\" (UID: \"6d802a43-8008-4ebb-91df-efd9da4b3eb1\") " pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:44.064178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.064147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d802a43-8008-4ebb-91df-efd9da4b3eb1-bound-sa-token\") pod \"cert-manager-59c77684cc-qq5hv\" (UID: \"6d802a43-8008-4ebb-91df-efd9da4b3eb1\") " pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:44.064178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.064164 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28l7g\" (UniqueName: \"kubernetes.io/projected/6d802a43-8008-4ebb-91df-efd9da4b3eb1-kube-api-access-28l7g\") pod \"cert-manager-59c77684cc-qq5hv\" (UID: \"6d802a43-8008-4ebb-91df-efd9da4b3eb1\") " pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:44.135682 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.135604 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-qq5hv" Jun 05 21:30:44.262805 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.262777 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-qq5hv"] Jun 05 21:30:44.265728 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:30:44.265697 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d802a43_8008_4ebb_91df_efd9da4b3eb1.slice/crio-39402d31a5a71f52fa88b2f6b85ca91992cd7ef03ed61ed0ae750060ac9598fc WatchSource:0}: Error finding container 39402d31a5a71f52fa88b2f6b85ca91992cd7ef03ed61ed0ae750060ac9598fc: Status 404 returned error can't find the container with id 39402d31a5a71f52fa88b2f6b85ca91992cd7ef03ed61ed0ae750060ac9598fc Jun 05 21:30:44.834016 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.833981 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-qq5hv" event={"ID":"6d802a43-8008-4ebb-91df-efd9da4b3eb1","Type":"ContainerStarted","Data":"3ce0a23795cde6533e4c6f6bab5ce666d2eea322dd337e813857c2a51a787184"} Jun 05 21:30:44.834408 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.834026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-qq5hv" event={"ID":"6d802a43-8008-4ebb-91df-efd9da4b3eb1","Type":"ContainerStarted","Data":"39402d31a5a71f52fa88b2f6b85ca91992cd7ef03ed61ed0ae750060ac9598fc"} Jun 05 21:30:44.851239 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:44.851192 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-qq5hv" podStartSLOduration=1.851176514 podStartE2EDuration="1.851176514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:30:44.850243244 +0000 UTC m=+728.087032443" watchObservedRunningTime="2026-06-05 21:30:44.851176514 +0000 UTC m=+728.087965711" Jun 05 21:30:57.666314 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.666276 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb"] Jun 05 21:30:57.671234 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.671211 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.675639 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.675618 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 21:30:57.676209 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.676187 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 21:30:57.676298 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.676220 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 21:30:57.676298 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.676259 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9chch\"" Jun 05 21:30:57.676532 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.676516 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 21:30:57.692149 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.692125 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb"] Jun 05 21:30:57.769449 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.769417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.769638 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.769455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltw7z\" (UniqueName: \"kubernetes.io/projected/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-kube-api-access-ltw7z\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.769638 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.769483 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-tmp\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.769763 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.769632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.769763 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.769703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-manifests\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.870742 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.870712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-manifests\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.870742 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.870748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.871137 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.870772 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltw7z\" (UniqueName: \"kubernetes.io/projected/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-kube-api-access-ltw7z\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.871137 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.870797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-tmp\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.871137 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.870847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.871137 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.871133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-manifests\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.873210 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.873189 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-tmp\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.873387 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.873364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.873459 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.873445 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.895037 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.895010 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltw7z\" (UniqueName: \"kubernetes.io/projected/2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0-kube-api-access-ltw7z\") pod \"opendatahub-operator-controller-manager-5df7699bf6-twckb\" (UID: \"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:57.981997 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:57.981908 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:30:58.123710 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:58.123684 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb"] Jun 05 21:30:58.125794 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:30:58.125766 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b534fdb_70d1_4a4e_8aef_5b11ce1e3bc0.slice/crio-29004e7526000d58c988095fd7336e095cecdefbfb1e1beeff4db68cf4cd206e WatchSource:0}: Error finding container 29004e7526000d58c988095fd7336e095cecdefbfb1e1beeff4db68cf4cd206e: Status 404 returned error can't find the container with id 29004e7526000d58c988095fd7336e095cecdefbfb1e1beeff4db68cf4cd206e Jun 05 21:30:58.896344 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:30:58.896297 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" event={"ID":"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0","Type":"ContainerStarted","Data":"29004e7526000d58c988095fd7336e095cecdefbfb1e1beeff4db68cf4cd206e"} Jun 05 21:31:01.910302 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:01.910266 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" event={"ID":"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0","Type":"ContainerStarted","Data":"1c08587b683b7e421359a0e8df4e678581fc7167a556a08a677081c1310c74e5"} Jun 05 21:31:02.916133 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:02.916086 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0" containerID="1c08587b683b7e421359a0e8df4e678581fc7167a556a08a677081c1310c74e5" exitCode=0 Jun 05 21:31:02.916517 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:02.916171 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" event={"ID":"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0","Type":"ContainerDied","Data":"1c08587b683b7e421359a0e8df4e678581fc7167a556a08a677081c1310c74e5"} Jun 05 21:31:03.921729 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:03.921693 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" event={"ID":"2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0","Type":"ContainerStarted","Data":"37672404f9a77dad8cb7c246c319a515863d229ad5d505354a58889e9dfaf7f2"} Jun 05 21:31:03.922128 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:03.921805 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:31:03.943231 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:03.943177 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" podStartSLOduration=2.744752921 podStartE2EDuration="6.943158845s" totalImagesPullingTime="3.195331925s" totalInitContainerRuntime="1.003073999s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:30:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:03.942339545 +0000 UTC m=+747.179128768" watchObservedRunningTime="2026-06-05 21:31:03.943158845 +0000 UTC m=+747.179948054" Jun 05 21:31:14.928969 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:14.928937 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-twckb" Jun 05 21:31:17.394298 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.394261 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw"] Jun 05 21:31:17.403451 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.403428 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.418286 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.418259 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 21:31:17.418497 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.418478 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:31:17.418556 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.418478 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 21:31:17.418816 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.418803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 21:31:17.418866 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.418803 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 21:31:17.418866 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.418858 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bggdj\"" Jun 05 21:31:17.432374 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.432340 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw"] Jun 05 21:31:17.540851 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.540810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07e7c9af-2171-4208-8a25-d286c7d1edf9-manager-config\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.541050 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.540891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnkdd\" (UniqueName: \"kubernetes.io/projected/07e7c9af-2171-4208-8a25-d286c7d1edf9-kube-api-access-cnkdd\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.541050 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.540962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07e7c9af-2171-4208-8a25-d286c7d1edf9-metrics-cert\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.541050 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.540996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e7c9af-2171-4208-8a25-d286c7d1edf9-cert\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.642098 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.642060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07e7c9af-2171-4208-8a25-d286c7d1edf9-manager-config\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.642279 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.642112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnkdd\" (UniqueName: \"kubernetes.io/projected/07e7c9af-2171-4208-8a25-d286c7d1edf9-kube-api-access-cnkdd\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.642279 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.642152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07e7c9af-2171-4208-8a25-d286c7d1edf9-metrics-cert\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.642279 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.642184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e7c9af-2171-4208-8a25-d286c7d1edf9-cert\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.642892 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.642851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07e7c9af-2171-4208-8a25-d286c7d1edf9-manager-config\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.644957 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.644902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07e7c9af-2171-4208-8a25-d286c7d1edf9-cert\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.644957 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.644924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07e7c9af-2171-4208-8a25-d286c7d1edf9-metrics-cert\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.660373 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.660346 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnkdd\" (UniqueName: \"kubernetes.io/projected/07e7c9af-2171-4208-8a25-d286c7d1edf9-kube-api-access-cnkdd\") pod \"lws-controller-manager-7c554fd75b-m4pjw\" (UID: \"07e7c9af-2171-4208-8a25-d286c7d1edf9\") " pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.713138 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.713102 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:17.866361 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.866236 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw"] Jun 05 21:31:17.869010 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:31:17.868981 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e7c9af_2171_4208_8a25_d286c7d1edf9.slice/crio-73e187042057d13bf5ae3068b86e904b5d8d025b5eeb27db70d6824e88d68893 WatchSource:0}: Error finding container 73e187042057d13bf5ae3068b86e904b5d8d025b5eeb27db70d6824e88d68893: Status 404 returned error can't find the container with id 73e187042057d13bf5ae3068b86e904b5d8d025b5eeb27db70d6824e88d68893 Jun 05 21:31:17.981968 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:17.981864 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" event={"ID":"07e7c9af-2171-4208-8a25-d286c7d1edf9","Type":"ContainerStarted","Data":"73e187042057d13bf5ae3068b86e904b5d8d025b5eeb27db70d6824e88d68893"} Jun 05 21:31:20.998484 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:20.998445 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" event={"ID":"07e7c9af-2171-4208-8a25-d286c7d1edf9","Type":"ContainerStarted","Data":"cb38298b5457beb4558157b15d1d20ea2cfc31f247f1e5572be3f439d3a13da1"} Jun 05 21:31:20.998899 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:20.998593 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:21.015603 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:21.015557 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" podStartSLOduration=1.666757795 podStartE2EDuration="4.015542042s" totalImagesPullingTime="2.348784247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:21.013911398 +0000 UTC m=+764.250700609" watchObservedRunningTime="2026-06-05 21:31:21.015542042 +0000 UTC m=+764.252331240" Jun 05 21:31:32.006246 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:32.006216 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c554fd75b-m4pjw" Jun 05 21:31:33.608107 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.608066 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-f857d6fdf-n6jbt"] Jun 05 21:31:33.611715 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.611691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:33.615053 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.615031 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7dhnm\"" Jun 05 21:31:33.615250 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.615232 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 21:31:33.627856 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.627833 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f857d6fdf-n6jbt"] Jun 05 21:31:33.693045 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.693007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvkm2\" (UniqueName: \"kubernetes.io/projected/cb8ef834-06b9-415f-912f-b2fd9c14fa2e-kube-api-access-vvkm2\") pod \"dashboard-redirect-f857d6fdf-n6jbt\" (UID: \"cb8ef834-06b9-415f-912f-b2fd9c14fa2e\") " pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:33.693045 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.693051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cb8ef834-06b9-415f-912f-b2fd9c14fa2e-redirect-config\") pod \"dashboard-redirect-f857d6fdf-n6jbt\" (UID: \"cb8ef834-06b9-415f-912f-b2fd9c14fa2e\") " pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:33.794486 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.794452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvkm2\" (UniqueName: \"kubernetes.io/projected/cb8ef834-06b9-415f-912f-b2fd9c14fa2e-kube-api-access-vvkm2\") pod \"dashboard-redirect-f857d6fdf-n6jbt\" (UID: \"cb8ef834-06b9-415f-912f-b2fd9c14fa2e\") " pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:33.794664 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.794497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cb8ef834-06b9-415f-912f-b2fd9c14fa2e-redirect-config\") pod \"dashboard-redirect-f857d6fdf-n6jbt\" (UID: \"cb8ef834-06b9-415f-912f-b2fd9c14fa2e\") " pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:33.795232 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.795213 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cb8ef834-06b9-415f-912f-b2fd9c14fa2e-redirect-config\") pod \"dashboard-redirect-f857d6fdf-n6jbt\" (UID: \"cb8ef834-06b9-415f-912f-b2fd9c14fa2e\") " pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:33.817417 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.817391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvkm2\" (UniqueName: \"kubernetes.io/projected/cb8ef834-06b9-415f-912f-b2fd9c14fa2e-kube-api-access-vvkm2\") pod \"dashboard-redirect-f857d6fdf-n6jbt\" (UID: \"cb8ef834-06b9-415f-912f-b2fd9c14fa2e\") " pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:33.922621 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:33.922533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" Jun 05 21:31:34.078569 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:34.078535 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f857d6fdf-n6jbt"] Jun 05 21:31:34.093333 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:31:34.093307 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8ef834_06b9_415f_912f_b2fd9c14fa2e.slice/crio-4e3e86fd6d93861eb1e091bf6cab52eefc583c1b8aa3b1201c91a6ccb470f553 WatchSource:0}: Error finding container 4e3e86fd6d93861eb1e091bf6cab52eefc583c1b8aa3b1201c91a6ccb470f553: Status 404 returned error can't find the container with id 4e3e86fd6d93861eb1e091bf6cab52eefc583c1b8aa3b1201c91a6ccb470f553 Jun 05 21:31:35.062546 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:35.062506 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" event={"ID":"cb8ef834-06b9-415f-912f-b2fd9c14fa2e","Type":"ContainerStarted","Data":"4e3e86fd6d93861eb1e091bf6cab52eefc583c1b8aa3b1201c91a6ccb470f553"} Jun 05 21:31:37.073310 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:37.073269 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" event={"ID":"cb8ef834-06b9-415f-912f-b2fd9c14fa2e","Type":"ContainerStarted","Data":"a318537725d6bc59fdb006314a463b138c728ad2cc92fdde7243c3b63a8bd773"} Jun 05 21:31:37.089825 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:37.089770 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-f857d6fdf-n6jbt" podStartSLOduration=1.55502566 podStartE2EDuration="4.089750944s" totalImagesPullingTime="2.534725284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:37.089280214 +0000 UTC m=+780.326069452" watchObservedRunningTime="2026-06-05 21:31:37.089750944 +0000 UTC m=+780.326540141" Jun 05 21:31:47.700724 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.700685 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969"] Jun 05 21:31:47.704654 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.704633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.706746 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.706726 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 21:31:47.706997 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.706975 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ltg7m\"" Jun 05 21:31:47.707092 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.707023 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 21:31:47.707092 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.706975 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 21:31:47.714254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.714234 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969"] Jun 05 21:31:47.804228 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804406 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804406 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804406 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804406 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7wc5\" (UniqueName: \"kubernetes.io/projected/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-kube-api-access-m7wc5\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804560 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804410 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804560 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804560 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804483 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.804666 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.804554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.904932 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.904869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905098 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.904945 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905098 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.904985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905125 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905326 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905198 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905326 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905238 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905326 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7wc5\" (UniqueName: \"kubernetes.io/projected/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-kube-api-access-m7wc5\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905461 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905461 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905436 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905571 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905697 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905675 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.905945 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.905926 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.907490 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.907464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.907678 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.907654 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.913900 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.913853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7wc5\" (UniqueName: \"kubernetes.io/projected/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-kube-api-access-m7wc5\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:47.914034 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:47.914014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97956z969\" (UID: \"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:48.015970 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:48.015869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:48.156924 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:48.156890 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969"] Jun 05 21:31:48.160149 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:31:48.160110 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453a7f93_8b7a_4d7a_bae5_30b7b32fdb8d.slice/crio-f74f187632acaf10ec554eef4c90b2cf4f49e6866106cd0a28a3d744e0359fe1 WatchSource:0}: Error finding container f74f187632acaf10ec554eef4c90b2cf4f49e6866106cd0a28a3d744e0359fe1: Status 404 returned error can't find the container with id f74f187632acaf10ec554eef4c90b2cf4f49e6866106cd0a28a3d744e0359fe1 Jun 05 21:31:49.128619 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:49.128579 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" event={"ID":"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d","Type":"ContainerStarted","Data":"f74f187632acaf10ec554eef4c90b2cf4f49e6866106cd0a28a3d744e0359fe1"} Jun 05 21:31:50.889117 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:50.889061 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:31:50.889400 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:50.889148 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:31:50.889400 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:50.889186 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:31:51.140284 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:51.140197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" event={"ID":"453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d","Type":"ContainerStarted","Data":"b1d39e9cef3ca5dfed9b8fa56839f3d62320ea35cc9f03199ab9283b8bbc8d8f"} Jun 05 21:31:51.161488 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:51.161424 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" podStartSLOduration=1.434793804 podStartE2EDuration="4.161391656s" totalImagesPullingTime="2.726597852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:51.160516185 +0000 UTC m=+794.397305384" watchObservedRunningTime="2026-06-05 21:31:51.161391656 +0000 UTC m=+794.398180855" Jun 05 21:31:52.017043 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:52.017003 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:52.022019 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:52.021992 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:52.144508 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:52.144479 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:31:52.145475 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:31:52.145459 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97956z969" Jun 05 21:32:18.147146 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.147054 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zqpkf"] Jun 05 21:32:18.158784 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.158756 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zqpkf"] Jun 05 21:32:18.158966 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.158862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" Jun 05 21:32:18.161114 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.161087 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 21:32:18.161243 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.161091 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-tbzk4\"" Jun 05 21:32:18.161779 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.161753 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 21:32:18.263495 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.263460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dsph\" (UniqueName: \"kubernetes.io/projected/f6fee5ef-7a18-48c1-9407-8660342038ff-kube-api-access-2dsph\") pod \"kuadrant-operator-catalog-zqpkf\" (UID: \"f6fee5ef-7a18-48c1-9407-8660342038ff\") " pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" Jun 05 21:32:18.363927 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.363890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dsph\" (UniqueName: \"kubernetes.io/projected/f6fee5ef-7a18-48c1-9407-8660342038ff-kube-api-access-2dsph\") pod \"kuadrant-operator-catalog-zqpkf\" (UID: \"f6fee5ef-7a18-48c1-9407-8660342038ff\") " pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" Jun 05 21:32:18.371146 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.371121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dsph\" (UniqueName: \"kubernetes.io/projected/f6fee5ef-7a18-48c1-9407-8660342038ff-kube-api-access-2dsph\") pod \"kuadrant-operator-catalog-zqpkf\" (UID: \"f6fee5ef-7a18-48c1-9407-8660342038ff\") " pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" Jun 05 21:32:18.471190 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.471105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" Jun 05 21:32:18.514910 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.514863 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zqpkf"] Jun 05 21:32:18.606614 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.606587 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zqpkf"] Jun 05 21:32:18.609437 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:32:18.609412 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fee5ef_7a18_48c1_9407_8660342038ff.slice/crio-dbfac24c5355d9340c44595ed023ab67f728e77977c263516df752fd04eecdb3 WatchSource:0}: Error finding container dbfac24c5355d9340c44595ed023ab67f728e77977c263516df752fd04eecdb3: Status 404 returned error can't find the container with id dbfac24c5355d9340c44595ed023ab67f728e77977c263516df752fd04eecdb3 Jun 05 21:32:18.725991 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.725911 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b2l2m"] Jun 05 21:32:18.730535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.730519 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:18.735735 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.735707 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b2l2m"] Jun 05 21:32:18.869447 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.869410 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgmnw\" (UniqueName: \"kubernetes.io/projected/fda54ce6-1e94-437c-8d61-d8c3a3c687ce-kube-api-access-wgmnw\") pod \"kuadrant-operator-catalog-b2l2m\" (UID: \"fda54ce6-1e94-437c-8d61-d8c3a3c687ce\") " pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:18.969858 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.969827 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgmnw\" (UniqueName: \"kubernetes.io/projected/fda54ce6-1e94-437c-8d61-d8c3a3c687ce-kube-api-access-wgmnw\") pod \"kuadrant-operator-catalog-b2l2m\" (UID: \"fda54ce6-1e94-437c-8d61-d8c3a3c687ce\") " pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:18.978199 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:18.978135 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgmnw\" (UniqueName: \"kubernetes.io/projected/fda54ce6-1e94-437c-8d61-d8c3a3c687ce-kube-api-access-wgmnw\") pod \"kuadrant-operator-catalog-b2l2m\" (UID: \"fda54ce6-1e94-437c-8d61-d8c3a3c687ce\") " pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:19.041251 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:19.041219 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:19.184816 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:19.184737 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b2l2m"] Jun 05 21:32:19.186944 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:32:19.186915 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda54ce6_1e94_437c_8d61_d8c3a3c687ce.slice/crio-e37d51bdf2cde76d68ac0f547a3548643dcba7e47643abd0f89f74c686e5bf03 WatchSource:0}: Error finding container e37d51bdf2cde76d68ac0f547a3548643dcba7e47643abd0f89f74c686e5bf03: Status 404 returned error can't find the container with id e37d51bdf2cde76d68ac0f547a3548643dcba7e47643abd0f89f74c686e5bf03 Jun 05 21:32:19.262609 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:19.262532 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" event={"ID":"f6fee5ef-7a18-48c1-9407-8660342038ff","Type":"ContainerStarted","Data":"dbfac24c5355d9340c44595ed023ab67f728e77977c263516df752fd04eecdb3"} Jun 05 21:32:19.263620 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:19.263595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" event={"ID":"fda54ce6-1e94-437c-8d61-d8c3a3c687ce","Type":"ContainerStarted","Data":"e37d51bdf2cde76d68ac0f547a3548643dcba7e47643abd0f89f74c686e5bf03"} Jun 05 21:32:21.274825 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.274776 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" event={"ID":"f6fee5ef-7a18-48c1-9407-8660342038ff","Type":"ContainerStarted","Data":"f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8"} Jun 05 21:32:21.275275 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.274797 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" podUID="f6fee5ef-7a18-48c1-9407-8660342038ff" containerName="registry-server" containerID="cri-o://f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8" gracePeriod=2 Jun 05 21:32:21.276323 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.276299 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" event={"ID":"fda54ce6-1e94-437c-8d61-d8c3a3c687ce","Type":"ContainerStarted","Data":"08a062fabab33792953c36d983d69450a764a0e6af03ba1cce5487b4fbfebf9c"} Jun 05 21:32:21.292055 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.292010 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" podStartSLOduration=1.102748435 podStartE2EDuration="3.291993796s" totalImagesPullingTime="2.189245361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:32:21.290962093 +0000 UTC m=+824.527751310" watchObservedRunningTime="2026-06-05 21:32:21.291993796 +0000 UTC m=+824.528782993" Jun 05 21:32:21.305211 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.305166 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" podStartSLOduration=1.69025683 podStartE2EDuration="3.305150157s" totalImagesPullingTime="1.614893327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:32:21.304138109 +0000 UTC m=+824.540927308" watchObservedRunningTime="2026-06-05 21:32:21.305150157 +0000 UTC m=+824.541939357" Jun 05 21:32:21.518679 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.518653 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" Jun 05 21:32:21.598901 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.598811 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dsph\" (UniqueName: \"kubernetes.io/projected/f6fee5ef-7a18-48c1-9407-8660342038ff-kube-api-access-2dsph\") pod \"f6fee5ef-7a18-48c1-9407-8660342038ff\" (UID: \"f6fee5ef-7a18-48c1-9407-8660342038ff\") " Jun 05 21:32:21.600796 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.600774 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6fee5ef-7a18-48c1-9407-8660342038ff-kube-api-access-2dsph" (OuterVolumeSpecName: "kube-api-access-2dsph") pod "f6fee5ef-7a18-48c1-9407-8660342038ff" (UID: "f6fee5ef-7a18-48c1-9407-8660342038ff"). InnerVolumeSpecName "kube-api-access-2dsph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:32:21.700123 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:21.700080 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dsph\" (UniqueName: \"kubernetes.io/projected/f6fee5ef-7a18-48c1-9407-8660342038ff-kube-api-access-2dsph\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:32:22.282377 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.282338 2567 generic.go:356] "Generic (PLEG): container finished" podID="f6fee5ef-7a18-48c1-9407-8660342038ff" containerID="f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8" exitCode=0 Jun 05 21:32:22.282824 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.282388 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" Jun 05 21:32:22.282824 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.282431 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" event={"ID":"f6fee5ef-7a18-48c1-9407-8660342038ff","Type":"ContainerDied","Data":"f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8"} Jun 05 21:32:22.282824 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.282494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zqpkf" event={"ID":"f6fee5ef-7a18-48c1-9407-8660342038ff","Type":"ContainerDied","Data":"dbfac24c5355d9340c44595ed023ab67f728e77977c263516df752fd04eecdb3"} Jun 05 21:32:22.282824 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.282519 2567 scope.go:117] "RemoveContainer" containerID="f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8" Jun 05 21:32:22.291680 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.291664 2567 scope.go:117] "RemoveContainer" containerID="f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8" Jun 05 21:32:22.291958 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:32:22.291936 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8\": container with ID starting with f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8 not found: ID does not exist" containerID="f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8" Jun 05 21:32:22.292024 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.291968 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8"} err="failed to get container status \"f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8\": rpc error: code = NotFound desc = could not find container \"f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8\": container with ID starting with f702dfce0fbc7339138db36920132946961df58e041ffe66d71ae741779805d8 not found: ID does not exist" Jun 05 21:32:22.301816 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.301790 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zqpkf"] Jun 05 21:32:22.310261 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:22.310242 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zqpkf"] Jun 05 21:32:23.197660 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:23.197623 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6fee5ef-7a18-48c1-9407-8660342038ff" path="/var/lib/kubelet/pods/f6fee5ef-7a18-48c1-9407-8660342038ff/volumes" Jun 05 21:32:29.042356 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:29.042320 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:29.042767 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:29.042379 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:29.064509 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:29.064481 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:29.335149 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:29.335076 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-b2l2m" Jun 05 21:32:51.319838 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.319800 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4"] Jun 05 21:32:51.320331 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.320169 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fee5ef-7a18-48c1-9407-8660342038ff" containerName="registry-server" Jun 05 21:32:51.320331 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.320180 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fee5ef-7a18-48c1-9407-8660342038ff" containerName="registry-server" Jun 05 21:32:51.320331 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.320240 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6fee5ef-7a18-48c1-9407-8660342038ff" containerName="registry-server" Jun 05 21:32:51.326592 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.326572 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.329847 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.329827 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9gd29\"" Jun 05 21:32:51.341940 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.341917 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4"] Jun 05 21:32:51.371449 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.371417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd9vw\" (UniqueName: \"kubernetes.io/projected/ba7411a9-5903-41d8-883f-bee72b49be33-kube-api-access-pd9vw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.371586 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.371498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba7411a9-5903-41d8-883f-bee72b49be33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.472426 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.472388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd9vw\" (UniqueName: \"kubernetes.io/projected/ba7411a9-5903-41d8-883f-bee72b49be33-kube-api-access-pd9vw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.472590 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.472482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba7411a9-5903-41d8-883f-bee72b49be33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.472824 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.472807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba7411a9-5903-41d8-883f-bee72b49be33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.485195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.485162 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd9vw\" (UniqueName: \"kubernetes.io/projected/ba7411a9-5903-41d8-883f-bee72b49be33-kube-api-access-pd9vw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.636269 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.636188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:51.772107 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:51.772073 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4"] Jun 05 21:32:51.775692 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:32:51.775666 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7411a9_5903_41d8_883f_bee72b49be33.slice/crio-d2a10b76cc96dfda96dec22835e54d1893312037867bb7a136fba4a32a099f56 WatchSource:0}: Error finding container d2a10b76cc96dfda96dec22835e54d1893312037867bb7a136fba4a32a099f56: Status 404 returned error can't find the container with id d2a10b76cc96dfda96dec22835e54d1893312037867bb7a136fba4a32a099f56 Jun 05 21:32:52.412754 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:52.412712 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" event={"ID":"ba7411a9-5903-41d8-883f-bee72b49be33","Type":"ContainerStarted","Data":"d2a10b76cc96dfda96dec22835e54d1893312037867bb7a136fba4a32a099f56"} Jun 05 21:32:56.001652 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.001611 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c"] Jun 05 21:32:56.006083 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.006057 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" Jun 05 21:32:56.008296 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.008275 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 21:32:56.008405 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.008281 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6nbp4\"" Jun 05 21:32:56.030714 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.030686 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c"] Jun 05 21:32:56.115046 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.115008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv9fl\" (UniqueName: \"kubernetes.io/projected/8f076441-b5b8-4c5b-9cd2-2ae1b5267efa-kube-api-access-rv9fl\") pod \"dns-operator-controller-manager-864dd78c4c-zps5c\" (UID: \"8f076441-b5b8-4c5b-9cd2-2ae1b5267efa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" Jun 05 21:32:56.216044 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.216004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv9fl\" (UniqueName: \"kubernetes.io/projected/8f076441-b5b8-4c5b-9cd2-2ae1b5267efa-kube-api-access-rv9fl\") pod \"dns-operator-controller-manager-864dd78c4c-zps5c\" (UID: \"8f076441-b5b8-4c5b-9cd2-2ae1b5267efa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" Jun 05 21:32:56.224043 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.224009 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv9fl\" (UniqueName: \"kubernetes.io/projected/8f076441-b5b8-4c5b-9cd2-2ae1b5267efa-kube-api-access-rv9fl\") pod \"dns-operator-controller-manager-864dd78c4c-zps5c\" (UID: \"8f076441-b5b8-4c5b-9cd2-2ae1b5267efa\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" Jun 05 21:32:56.318437 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.318369 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" Jun 05 21:32:56.733660 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:56.733637 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c"] Jun 05 21:32:56.736453 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:32:56.736416 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f076441_b5b8_4c5b_9cd2_2ae1b5267efa.slice/crio-2f7b8bdd8191b30822ded62e560b64f41728035f574344ba34ca76259a7a94b4 WatchSource:0}: Error finding container 2f7b8bdd8191b30822ded62e560b64f41728035f574344ba34ca76259a7a94b4: Status 404 returned error can't find the container with id 2f7b8bdd8191b30822ded62e560b64f41728035f574344ba34ca76259a7a94b4 Jun 05 21:32:57.441819 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:57.441779 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" event={"ID":"ba7411a9-5903-41d8-883f-bee72b49be33","Type":"ContainerStarted","Data":"55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0"} Jun 05 21:32:57.442284 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:57.441946 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:32:57.443566 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:57.443510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" event={"ID":"8f076441-b5b8-4c5b-9cd2-2ae1b5267efa","Type":"ContainerStarted","Data":"2f7b8bdd8191b30822ded62e560b64f41728035f574344ba34ca76259a7a94b4"} Jun 05 21:32:57.464694 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:57.464644 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" podStartSLOduration=1.5786029259999999 podStartE2EDuration="6.464628328s" totalImagesPullingTime="4.886025402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:32:57.463803897 +0000 UTC m=+860.700593123" watchObservedRunningTime="2026-06-05 21:32:57.464628328 +0000 UTC m=+860.701417584" Jun 05 21:32:59.452717 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.452683 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt"] Jun 05 21:32:59.456275 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.456244 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" Jun 05 21:32:59.456275 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.456272 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" event={"ID":"8f076441-b5b8-4c5b-9cd2-2ae1b5267efa","Type":"ContainerStarted","Data":"31a407a6d7b7dfa24dc4a7f50f08378297780f82f042bed0726466e22a50f57f"} Jun 05 21:32:59.456462 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.456345 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" Jun 05 21:32:59.458125 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.458099 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7xgc7\"" Jun 05 21:32:59.467847 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.467824 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt"] Jun 05 21:32:59.479354 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.479299 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" podStartSLOduration=1.966079289 podStartE2EDuration="4.479271952s" totalImagesPullingTime="2.513192663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:32:59.476718917 +0000 UTC m=+862.713508162" watchObservedRunningTime="2026-06-05 21:32:59.479271952 +0000 UTC m=+862.716061152" Jun 05 21:32:59.547647 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.547607 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zk8n\" (UniqueName: \"kubernetes.io/projected/bf9b6d10-12ff-423b-91bf-231ff1025d35-kube-api-access-2zk8n\") pod \"authorino-operator-75cc8d5cb7-vpvxt\" (UID: \"bf9b6d10-12ff-423b-91bf-231ff1025d35\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" Jun 05 21:32:59.649082 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.649039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zk8n\" (UniqueName: \"kubernetes.io/projected/bf9b6d10-12ff-423b-91bf-231ff1025d35-kube-api-access-2zk8n\") pod \"authorino-operator-75cc8d5cb7-vpvxt\" (UID: \"bf9b6d10-12ff-423b-91bf-231ff1025d35\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" Jun 05 21:32:59.658214 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.658190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zk8n\" (UniqueName: \"kubernetes.io/projected/bf9b6d10-12ff-423b-91bf-231ff1025d35-kube-api-access-2zk8n\") pod \"authorino-operator-75cc8d5cb7-vpvxt\" (UID: \"bf9b6d10-12ff-423b-91bf-231ff1025d35\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" Jun 05 21:32:59.766419 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.766386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" Jun 05 21:32:59.904820 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:32:59.904794 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt"] Jun 05 21:32:59.907248 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:32:59.907218 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9b6d10_12ff_423b_91bf_231ff1025d35.slice/crio-c3ba3be68aeaffea75ad4b9236739bebeb14257c01aedf709d2558617afe8aaa WatchSource:0}: Error finding container c3ba3be68aeaffea75ad4b9236739bebeb14257c01aedf709d2558617afe8aaa: Status 404 returned error can't find the container with id c3ba3be68aeaffea75ad4b9236739bebeb14257c01aedf709d2558617afe8aaa Jun 05 21:33:00.460773 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:00.460739 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" event={"ID":"bf9b6d10-12ff-423b-91bf-231ff1025d35","Type":"ContainerStarted","Data":"c3ba3be68aeaffea75ad4b9236739bebeb14257c01aedf709d2558617afe8aaa"} Jun 05 21:33:02.472348 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:02.472263 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" event={"ID":"bf9b6d10-12ff-423b-91bf-231ff1025d35","Type":"ContainerStarted","Data":"f19e1af1faa4040318f2a7b32509af867dcf25caf95806b37f35e445fd5a5687"} Jun 05 21:33:02.472699 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:02.472502 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" Jun 05 21:33:08.450285 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:08.450251 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:08.469508 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:08.469440 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" podStartSLOduration=7.239346332 podStartE2EDuration="9.469424343s" totalImagesPullingTime="2.230078011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:33:02.490389614 +0000 UTC m=+865.727178847" watchObservedRunningTime="2026-06-05 21:33:08.469424343 +0000 UTC m=+871.706213540" Jun 05 21:33:10.107573 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.107533 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4"] Jun 05 21:33:10.108031 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.107769 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" containerName="manager" containerID="cri-o://55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0" gracePeriod=2 Jun 05 21:33:10.116578 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.116551 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4"] Jun 05 21:33:10.134697 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.134671 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2"] Jun 05 21:33:10.135063 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.135044 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" containerName="manager" Jun 05 21:33:10.135063 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.135061 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" containerName="manager" Jun 05 21:33:10.135248 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.135129 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" containerName="manager" Jun 05 21:33:10.138009 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.137988 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.142056 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:33:10.142022 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" is forbidden: User \"system:node:ip-10-0-136-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-105.ec2.internal' and this object" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:10.152972 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.152947 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2"] Jun 05 21:33:10.238555 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.238524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0adb7db2-6362-4a05-ae05-c86974cec32d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dcfm2\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.238687 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.238581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tnqn\" (UniqueName: \"kubernetes.io/projected/0adb7db2-6362-4a05-ae05-c86974cec32d-kube-api-access-9tnqn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dcfm2\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.339523 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.339495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tnqn\" (UniqueName: \"kubernetes.io/projected/0adb7db2-6362-4a05-ae05-c86974cec32d-kube-api-access-9tnqn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dcfm2\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.339863 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.339833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0adb7db2-6362-4a05-ae05-c86974cec32d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dcfm2\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.340220 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.340200 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0adb7db2-6362-4a05-ae05-c86974cec32d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dcfm2\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.347501 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.347477 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tnqn\" (UniqueName: \"kubernetes.io/projected/0adb7db2-6362-4a05-ae05-c86974cec32d-kube-api-access-9tnqn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dcfm2\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.348136 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.348115 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:10.350107 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:33:10.350079 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" is forbidden: User \"system:node:ip-10-0-136-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-105.ec2.internal' and this object" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:10.441334 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.441245 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd9vw\" (UniqueName: \"kubernetes.io/projected/ba7411a9-5903-41d8-883f-bee72b49be33-kube-api-access-pd9vw\") pod \"ba7411a9-5903-41d8-883f-bee72b49be33\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " Jun 05 21:33:10.441334 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.441327 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba7411a9-5903-41d8-883f-bee72b49be33-extensions-socket-volume\") pod \"ba7411a9-5903-41d8-883f-bee72b49be33\" (UID: \"ba7411a9-5903-41d8-883f-bee72b49be33\") " Jun 05 21:33:10.441855 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.441828 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba7411a9-5903-41d8-883f-bee72b49be33-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba7411a9-5903-41d8-883f-bee72b49be33" (UID: "ba7411a9-5903-41d8-883f-bee72b49be33"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:33:10.443347 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.443328 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7411a9-5903-41d8-883f-bee72b49be33-kube-api-access-pd9vw" (OuterVolumeSpecName: "kube-api-access-pd9vw") pod "ba7411a9-5903-41d8-883f-bee72b49be33" (UID: "ba7411a9-5903-41d8-883f-bee72b49be33"). InnerVolumeSpecName "kube-api-access-pd9vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:33:10.463221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.463198 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zps5c" Jun 05 21:33:10.486033 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:33:10.485997 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" is forbidden: User \"system:node:ip-10-0-136-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-105.ec2.internal' and this object" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:10.498214 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.498188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:10.511450 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.511420 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba7411a9-5903-41d8-883f-bee72b49be33" containerID="55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0" exitCode=0 Jun 05 21:33:10.511549 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.511479 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:10.511549 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.511519 2567 scope.go:117] "RemoveContainer" containerID="55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0" Jun 05 21:33:10.513573 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:33:10.513533 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" is forbidden: User \"system:node:ip-10-0-136-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-105.ec2.internal' and this object" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:10.521576 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.521557 2567 scope.go:117] "RemoveContainer" containerID="55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0" Jun 05 21:33:10.521863 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:33:10.521843 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0\": container with ID starting with 55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0 not found: ID does not exist" containerID="55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0" Jun 05 21:33:10.521992 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.521893 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0"} err="failed to get container status \"55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0\": rpc error: code = NotFound desc = could not find container \"55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0\": container with ID starting with 55bbcb345fa750cd3e163b09741a08d575029f6b9363cb1f0fb0371362d3b4c0 not found: ID does not exist" Jun 05 21:33:10.522249 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:33:10.522222 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8kjx4\" is forbidden: User \"system:node:ip-10-0-136-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-105.ec2.internal' and this object" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8kjx4" Jun 05 21:33:10.542895 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.542842 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd9vw\" (UniqueName: \"kubernetes.io/projected/ba7411a9-5903-41d8-883f-bee72b49be33-kube-api-access-pd9vw\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:33:10.542895 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.542891 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba7411a9-5903-41d8-883f-bee72b49be33-extensions-socket-volume\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:33:10.638812 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:10.638778 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2"] Jun 05 21:33:10.643404 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:33:10.643376 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0adb7db2_6362_4a05_ae05_c86974cec32d.slice/crio-f52aef6a3f34cbdff129d3276fb3f531f7c06cd63f9a84e886be51d8b5f8bc9b WatchSource:0}: Error finding container f52aef6a3f34cbdff129d3276fb3f531f7c06cd63f9a84e886be51d8b5f8bc9b: Status 404 returned error can't find the container with id f52aef6a3f34cbdff129d3276fb3f531f7c06cd63f9a84e886be51d8b5f8bc9b Jun 05 21:33:11.198147 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:11.198114 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba7411a9-5903-41d8-883f-bee72b49be33" path="/var/lib/kubelet/pods/ba7411a9-5903-41d8-883f-bee72b49be33/volumes" Jun 05 21:33:11.518225 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:11.518132 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" event={"ID":"0adb7db2-6362-4a05-ae05-c86974cec32d","Type":"ContainerStarted","Data":"2b4c5ddda3ba792543aa85bcb601e6ec49574dc5cd368cb1def64edd28ed3c53"} Jun 05 21:33:11.518225 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:11.518184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" event={"ID":"0adb7db2-6362-4a05-ae05-c86974cec32d","Type":"ContainerStarted","Data":"f52aef6a3f34cbdff129d3276fb3f531f7c06cd63f9a84e886be51d8b5f8bc9b"} Jun 05 21:33:11.518470 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:11.518274 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:11.542630 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:11.542582 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" podStartSLOduration=1.542566834 podStartE2EDuration="1.542566834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:33:11.539859693 +0000 UTC m=+874.776648891" watchObservedRunningTime="2026-06-05 21:33:11.542566834 +0000 UTC m=+874.779356032" Jun 05 21:33:13.479737 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:13.479701 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vpvxt" Jun 05 21:33:22.525711 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:22.525678 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:27.456833 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.456756 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2"] Jun 05 21:33:27.457202 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.456956 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" podUID="0adb7db2-6362-4a05-ae05-c86974cec32d" containerName="manager" containerID="cri-o://2b4c5ddda3ba792543aa85bcb601e6ec49574dc5cd368cb1def64edd28ed3c53" gracePeriod=10 Jun 05 21:33:27.611871 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.611836 2567 generic.go:356] "Generic (PLEG): container finished" podID="0adb7db2-6362-4a05-ae05-c86974cec32d" containerID="2b4c5ddda3ba792543aa85bcb601e6ec49574dc5cd368cb1def64edd28ed3c53" exitCode=0 Jun 05 21:33:27.612052 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.611913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" event={"ID":"0adb7db2-6362-4a05-ae05-c86974cec32d","Type":"ContainerDied","Data":"2b4c5ddda3ba792543aa85bcb601e6ec49574dc5cd368cb1def64edd28ed3c53"} Jun 05 21:33:27.710175 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.710110 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:27.790523 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.790483 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tnqn\" (UniqueName: \"kubernetes.io/projected/0adb7db2-6362-4a05-ae05-c86974cec32d-kube-api-access-9tnqn\") pod \"0adb7db2-6362-4a05-ae05-c86974cec32d\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " Jun 05 21:33:27.790715 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.790622 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0adb7db2-6362-4a05-ae05-c86974cec32d-extensions-socket-volume\") pod \"0adb7db2-6362-4a05-ae05-c86974cec32d\" (UID: \"0adb7db2-6362-4a05-ae05-c86974cec32d\") " Jun 05 21:33:27.791076 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.791045 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0adb7db2-6362-4a05-ae05-c86974cec32d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0adb7db2-6362-4a05-ae05-c86974cec32d" (UID: "0adb7db2-6362-4a05-ae05-c86974cec32d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:33:27.792602 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.792575 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0adb7db2-6362-4a05-ae05-c86974cec32d-kube-api-access-9tnqn" (OuterVolumeSpecName: "kube-api-access-9tnqn") pod "0adb7db2-6362-4a05-ae05-c86974cec32d" (UID: "0adb7db2-6362-4a05-ae05-c86974cec32d"). InnerVolumeSpecName "kube-api-access-9tnqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:33:27.891407 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.891367 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0adb7db2-6362-4a05-ae05-c86974cec32d-extensions-socket-volume\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:33:27.891407 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:27.891407 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tnqn\" (UniqueName: \"kubernetes.io/projected/0adb7db2-6362-4a05-ae05-c86974cec32d-kube-api-access-9tnqn\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:33:28.617856 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:28.617818 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" event={"ID":"0adb7db2-6362-4a05-ae05-c86974cec32d","Type":"ContainerDied","Data":"f52aef6a3f34cbdff129d3276fb3f531f7c06cd63f9a84e886be51d8b5f8bc9b"} Jun 05 21:33:28.618332 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:28.617892 2567 scope.go:117] "RemoveContainer" containerID="2b4c5ddda3ba792543aa85bcb601e6ec49574dc5cd368cb1def64edd28ed3c53" Jun 05 21:33:28.618332 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:28.617834 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2" Jun 05 21:33:28.641609 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:28.641584 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2"] Jun 05 21:33:28.645361 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:28.645338 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dcfm2"] Jun 05 21:33:29.198782 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:29.198741 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0adb7db2-6362-4a05-ae05-c86974cec32d" path="/var/lib/kubelet/pods/0adb7db2-6362-4a05-ae05-c86974cec32d/volumes" Jun 05 21:33:37.188488 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:37.188458 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:33:37.189366 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:37.189335 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:33:43.672488 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.672453 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv"] Jun 05 21:33:43.672961 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.672795 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0adb7db2-6362-4a05-ae05-c86974cec32d" containerName="manager" Jun 05 21:33:43.672961 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.672806 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0adb7db2-6362-4a05-ae05-c86974cec32d" containerName="manager" Jun 05 21:33:43.672961 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.672867 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0adb7db2-6362-4a05-ae05-c86974cec32d" containerName="manager" Jun 05 21:33:43.680813 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.680793 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.683943 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.683923 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hw89w\"" Jun 05 21:33:43.693272 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.693250 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv"] Jun 05 21:33:43.730863 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.730831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.730863 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.730863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.731058 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.730916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.731058 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.730942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.731058 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.730961 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.731162 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.731082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbncw\" (UniqueName: \"kubernetes.io/projected/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-kube-api-access-tbncw\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.731162 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.731127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.731162 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.731145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.731266 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.731194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbncw\" (UniqueName: \"kubernetes.io/projected/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-kube-api-access-tbncw\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832364 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832364 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832364 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832823 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832823 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832953 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.832953 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.832898 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.833181 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.833161 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.834635 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.834613 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.834977 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.834955 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.840970 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.840945 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbncw\" (UniqueName: \"kubernetes.io/projected/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-kube-api-access-tbncw\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.841050 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.840950 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03aaf96b-6488-47ef-bf4a-0fc448ab3a6a-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bldrv\" (UID: \"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:43.992070 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:43.991982 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:44.145643 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.145621 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv"] Jun 05 21:33:44.148147 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:33:44.148116 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03aaf96b_6488_47ef_bf4a_0fc448ab3a6a.slice/crio-5f179332162b3902b1f856366493550e0d8d4b42f2449125afd020e644e3813c WatchSource:0}: Error finding container 5f179332162b3902b1f856366493550e0d8d4b42f2449125afd020e644e3813c: Status 404 returned error can't find the container with id 5f179332162b3902b1f856366493550e0d8d4b42f2449125afd020e644e3813c Jun 05 21:33:44.150123 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.150094 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:33:44.150221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.150163 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:33:44.150221 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.150192 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:33:44.694518 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.694481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" event={"ID":"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a","Type":"ContainerStarted","Data":"4ae4977c4fe39b301e2c0d351562160e9ee9dbfc13981ff4b8d4251d355c978c"} Jun 05 21:33:44.694926 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.694543 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" event={"ID":"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a","Type":"ContainerStarted","Data":"5f179332162b3902b1f856366493550e0d8d4b42f2449125afd020e644e3813c"} Jun 05 21:33:44.712824 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.712770 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" podStartSLOduration=1.7127500549999999 podStartE2EDuration="1.712750055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:33:44.711971761 +0000 UTC m=+907.948760982" watchObservedRunningTime="2026-06-05 21:33:44.712750055 +0000 UTC m=+907.949539254" Jun 05 21:33:44.992500 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:44.992416 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:45.997406 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:45.997370 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:46.703720 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:46.703689 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:46.704646 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:46.704623 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:33:47.871693 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.871661 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g72db"] Jun 05 21:33:47.875213 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.875194 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:47.877303 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.877286 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 21:33:47.877659 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.877645 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lfm28\"" Jun 05 21:33:47.885392 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.885370 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g72db"] Jun 05 21:33:47.970579 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.970537 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g72db"] Jun 05 21:33:47.970869 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.970849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34c1f8e3-9393-46ba-9b25-31ced1bb657d-config-file\") pod \"limitador-limitador-64c94fd64f-g72db\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:47.970961 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:47.970946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7ltg\" (UniqueName: \"kubernetes.io/projected/34c1f8e3-9393-46ba-9b25-31ced1bb657d-kube-api-access-l7ltg\") pod \"limitador-limitador-64c94fd64f-g72db\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:48.072126 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.072081 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34c1f8e3-9393-46ba-9b25-31ced1bb657d-config-file\") pod \"limitador-limitador-64c94fd64f-g72db\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:48.072366 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.072151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7ltg\" (UniqueName: \"kubernetes.io/projected/34c1f8e3-9393-46ba-9b25-31ced1bb657d-kube-api-access-l7ltg\") pod \"limitador-limitador-64c94fd64f-g72db\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:48.072935 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.072909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34c1f8e3-9393-46ba-9b25-31ced1bb657d-config-file\") pod \"limitador-limitador-64c94fd64f-g72db\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:48.080934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.080904 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7ltg\" (UniqueName: \"kubernetes.io/projected/34c1f8e3-9393-46ba-9b25-31ced1bb657d-kube-api-access-l7ltg\") pod \"limitador-limitador-64c94fd64f-g72db\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:48.186975 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.186865 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:48.323459 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.323392 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g72db"] Jun 05 21:33:48.325769 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:33:48.325744 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c1f8e3_9393_46ba_9b25_31ced1bb657d.slice/crio-49d6e5aa05b34766f2a326a3115b852053606cbaa184c268200ba6cf98597838 WatchSource:0}: Error finding container 49d6e5aa05b34766f2a326a3115b852053606cbaa184c268200ba6cf98597838: Status 404 returned error can't find the container with id 49d6e5aa05b34766f2a326a3115b852053606cbaa184c268200ba6cf98597838 Jun 05 21:33:48.713912 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.713854 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" event={"ID":"34c1f8e3-9393-46ba-9b25-31ced1bb657d","Type":"ContainerStarted","Data":"49d6e5aa05b34766f2a326a3115b852053606cbaa184c268200ba6cf98597838"} Jun 05 21:33:48.880257 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.880224 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-p4vdk"] Jun 05 21:33:48.883352 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.883334 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p4vdk" Jun 05 21:33:48.885592 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.885569 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c4knp\"" Jun 05 21:33:48.889701 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.889675 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p4vdk"] Jun 05 21:33:48.980931 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:48.980829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxn5w\" (UniqueName: \"kubernetes.io/projected/6d8636da-da86-4e52-a481-28ebdb703621-kube-api-access-zxn5w\") pod \"authorino-75d556bd77-p4vdk\" (UID: \"6d8636da-da86-4e52-a481-28ebdb703621\") " pod="kuadrant-system/authorino-75d556bd77-p4vdk" Jun 05 21:33:49.081794 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:49.081599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxn5w\" (UniqueName: \"kubernetes.io/projected/6d8636da-da86-4e52-a481-28ebdb703621-kube-api-access-zxn5w\") pod \"authorino-75d556bd77-p4vdk\" (UID: \"6d8636da-da86-4e52-a481-28ebdb703621\") " pod="kuadrant-system/authorino-75d556bd77-p4vdk" Jun 05 21:33:49.093947 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:49.093916 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxn5w\" (UniqueName: \"kubernetes.io/projected/6d8636da-da86-4e52-a481-28ebdb703621-kube-api-access-zxn5w\") pod \"authorino-75d556bd77-p4vdk\" (UID: \"6d8636da-da86-4e52-a481-28ebdb703621\") " pod="kuadrant-system/authorino-75d556bd77-p4vdk" Jun 05 21:33:49.193993 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:49.193719 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p4vdk" Jun 05 21:33:49.370092 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:49.369711 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p4vdk"] Jun 05 21:33:49.373025 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:33:49.372991 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d8636da_da86_4e52_a481_28ebdb703621.slice/crio-6f069e1b9977ddc4961797f770955929876b18c7f1c37bd343a00eb2459984b1 WatchSource:0}: Error finding container 6f069e1b9977ddc4961797f770955929876b18c7f1c37bd343a00eb2459984b1: Status 404 returned error can't find the container with id 6f069e1b9977ddc4961797f770955929876b18c7f1c37bd343a00eb2459984b1 Jun 05 21:33:49.720659 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:49.720616 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p4vdk" event={"ID":"6d8636da-da86-4e52-a481-28ebdb703621","Type":"ContainerStarted","Data":"6f069e1b9977ddc4961797f770955929876b18c7f1c37bd343a00eb2459984b1"} Jun 05 21:33:51.734942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:51.734758 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" event={"ID":"34c1f8e3-9393-46ba-9b25-31ced1bb657d","Type":"ContainerStarted","Data":"28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e"} Jun 05 21:33:51.734942 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:51.734911 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:33:51.752854 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:51.752795 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" podStartSLOduration=1.696065222 podStartE2EDuration="4.752778453s" totalImagesPullingTime="3.056713231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:33:51.750275053 +0000 UTC m=+914.987064255" watchObservedRunningTime="2026-06-05 21:33:51.752778453 +0000 UTC m=+914.989567653" Jun 05 21:33:53.747721 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:53.747682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p4vdk" event={"ID":"6d8636da-da86-4e52-a481-28ebdb703621","Type":"ContainerStarted","Data":"bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557"} Jun 05 21:33:53.762587 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:33:53.762536 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-p4vdk" podStartSLOduration=1.929150449 podStartE2EDuration="5.762519784s" totalImagesPullingTime="3.833369335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:33:53.761271576 +0000 UTC m=+916.998060785" watchObservedRunningTime="2026-06-05 21:33:53.762519784 +0000 UTC m=+916.999309027" Jun 05 21:34:02.743606 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:02.743577 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:34:06.162232 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.162197 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g72db"] Jun 05 21:34:06.162736 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.162381 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" podUID="34c1f8e3-9393-46ba-9b25-31ced1bb657d" containerName="limitador" containerID="cri-o://28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e" gracePeriod=30 Jun 05 21:34:06.717329 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.717298 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:34:06.807445 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.807409 2567 generic.go:356] "Generic (PLEG): container finished" podID="34c1f8e3-9393-46ba-9b25-31ced1bb657d" containerID="28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e" exitCode=0 Jun 05 21:34:06.807580 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.807458 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" Jun 05 21:34:06.807580 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.807499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" event={"ID":"34c1f8e3-9393-46ba-9b25-31ced1bb657d","Type":"ContainerDied","Data":"28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e"} Jun 05 21:34:06.807580 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.807554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g72db" event={"ID":"34c1f8e3-9393-46ba-9b25-31ced1bb657d","Type":"ContainerDied","Data":"49d6e5aa05b34766f2a326a3115b852053606cbaa184c268200ba6cf98597838"} Jun 05 21:34:06.807580 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.807576 2567 scope.go:117] "RemoveContainer" containerID="28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e" Jun 05 21:34:06.815758 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.815739 2567 scope.go:117] "RemoveContainer" containerID="28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e" Jun 05 21:34:06.816008 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:34:06.815989 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e\": container with ID starting with 28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e not found: ID does not exist" containerID="28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e" Jun 05 21:34:06.816082 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.816021 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e"} err="failed to get container status \"28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e\": rpc error: code = NotFound desc = could not find container \"28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e\": container with ID starting with 28b02bb3171131d8d969103ddbbde24f84f871d21ef27662e8b33ebd75e3e23e not found: ID does not exist" Jun 05 21:34:06.851379 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.851351 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7ltg\" (UniqueName: \"kubernetes.io/projected/34c1f8e3-9393-46ba-9b25-31ced1bb657d-kube-api-access-l7ltg\") pod \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " Jun 05 21:34:06.851509 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.851456 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34c1f8e3-9393-46ba-9b25-31ced1bb657d-config-file\") pod \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\" (UID: \"34c1f8e3-9393-46ba-9b25-31ced1bb657d\") " Jun 05 21:34:06.851787 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.851763 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c1f8e3-9393-46ba-9b25-31ced1bb657d-config-file" (OuterVolumeSpecName: "config-file") pod "34c1f8e3-9393-46ba-9b25-31ced1bb657d" (UID: "34c1f8e3-9393-46ba-9b25-31ced1bb657d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:34:06.853441 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.853416 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c1f8e3-9393-46ba-9b25-31ced1bb657d-kube-api-access-l7ltg" (OuterVolumeSpecName: "kube-api-access-l7ltg") pod "34c1f8e3-9393-46ba-9b25-31ced1bb657d" (UID: "34c1f8e3-9393-46ba-9b25-31ced1bb657d"). InnerVolumeSpecName "kube-api-access-l7ltg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:34:06.953152 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.953115 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34c1f8e3-9393-46ba-9b25-31ced1bb657d-config-file\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:34:06.953152 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:06.953153 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7ltg\" (UniqueName: \"kubernetes.io/projected/34c1f8e3-9393-46ba-9b25-31ced1bb657d-kube-api-access-l7ltg\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:34:07.128625 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:07.128596 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g72db"] Jun 05 21:34:07.132994 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:07.132971 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g72db"] Jun 05 21:34:07.197447 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:07.197414 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c1f8e3-9393-46ba-9b25-31ced1bb657d" path="/var/lib/kubelet/pods/34c1f8e3-9393-46ba-9b25-31ced1bb657d/volumes" Jun 05 21:34:09.216930 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.216888 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46"] Jun 05 21:34:09.217480 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.217459 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c1f8e3-9393-46ba-9b25-31ced1bb657d" containerName="limitador" Jun 05 21:34:09.217548 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.217483 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c1f8e3-9393-46ba-9b25-31ced1bb657d" containerName="limitador" Jun 05 21:34:09.217640 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.217626 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c1f8e3-9393-46ba-9b25-31ced1bb657d" containerName="limitador" Jun 05 21:34:09.222414 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.222392 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.224675 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.224651 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 05 21:34:09.224788 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.224733 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 05 21:34:09.224788 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.224747 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 05 21:34:09.224925 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.224830 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-x5h6v\"" Jun 05 21:34:09.229427 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.229405 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46"] Jun 05 21:34:09.269414 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.269367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8n76\" (UniqueName: \"kubernetes.io/projected/92c1b7de-a0bd-408b-8548-197bea48ff86-kube-api-access-f8n76\") pod \"postgres-69fb4594cf-gdn46\" (UID: \"92c1b7de-a0bd-408b-8548-197bea48ff86\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.269578 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.269542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92c1b7de-a0bd-408b-8548-197bea48ff86-data\") pod \"postgres-69fb4594cf-gdn46\" (UID: \"92c1b7de-a0bd-408b-8548-197bea48ff86\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.370079 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.370044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8n76\" (UniqueName: \"kubernetes.io/projected/92c1b7de-a0bd-408b-8548-197bea48ff86-kube-api-access-f8n76\") pod \"postgres-69fb4594cf-gdn46\" (UID: \"92c1b7de-a0bd-408b-8548-197bea48ff86\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.370266 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.370086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92c1b7de-a0bd-408b-8548-197bea48ff86-data\") pod \"postgres-69fb4594cf-gdn46\" (UID: \"92c1b7de-a0bd-408b-8548-197bea48ff86\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.370532 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.370510 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92c1b7de-a0bd-408b-8548-197bea48ff86-data\") pod \"postgres-69fb4594cf-gdn46\" (UID: \"92c1b7de-a0bd-408b-8548-197bea48ff86\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.378501 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.378472 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8n76\" (UniqueName: \"kubernetes.io/projected/92c1b7de-a0bd-408b-8548-197bea48ff86-kube-api-access-f8n76\") pod \"postgres-69fb4594cf-gdn46\" (UID: \"92c1b7de-a0bd-408b-8548-197bea48ff86\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.534317 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.534288 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:09.668601 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.668557 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46"] Jun 05 21:34:09.671716 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:34:09.671691 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c1b7de_a0bd_408b_8548_197bea48ff86.slice/crio-93e4c971da1fbda0542ff0630ceb1930efa108293ed970fc724dc80070baa2c9 WatchSource:0}: Error finding container 93e4c971da1fbda0542ff0630ceb1930efa108293ed970fc724dc80070baa2c9: Status 404 returned error can't find the container with id 93e4c971da1fbda0542ff0630ceb1930efa108293ed970fc724dc80070baa2c9 Jun 05 21:34:09.822928 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:09.822811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" event={"ID":"92c1b7de-a0bd-408b-8548-197bea48ff86","Type":"ContainerStarted","Data":"93e4c971da1fbda0542ff0630ceb1930efa108293ed970fc724dc80070baa2c9"} Jun 05 21:34:12.843647 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:12.843609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" event={"ID":"92c1b7de-a0bd-408b-8548-197bea48ff86","Type":"ContainerStarted","Data":"98177c728866589fe0919d6f7a85fe8c1a0c24bb1fcc08a66336f735c658aa79"} Jun 05 21:34:12.844026 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:12.843692 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:12.861103 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:12.861056 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" podStartSLOduration=1.473652972 podStartE2EDuration="3.861040263s" totalImagesPullingTime="2.387387291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:34:12.85941475 +0000 UTC m=+936.096203949" watchObservedRunningTime="2026-06-05 21:34:12.861040263 +0000 UTC m=+936.097829460" Jun 05 21:34:18.880578 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:18.880550 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-gdn46" Jun 05 21:34:28.245182 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.245144 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-x7b9s"] Jun 05 21:34:28.255605 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.255576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" Jun 05 21:34:28.257049 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.257023 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-x7b9s"] Jun 05 21:34:28.257815 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.257794 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-spwwq\"" Jun 05 21:34:28.258252 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.258235 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 21:34:28.258355 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.258292 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 21:34:28.325248 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.325207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmwg6\" (UniqueName: \"kubernetes.io/projected/f83c0b5c-2c73-4e31-85b1-bc323c8896d8-kube-api-access-zmwg6\") pod \"keycloak-operator-dd84cbf46-x7b9s\" (UID: \"f83c0b5c-2c73-4e31-85b1-bc323c8896d8\") " pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" Jun 05 21:34:28.425918 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.425852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmwg6\" (UniqueName: \"kubernetes.io/projected/f83c0b5c-2c73-4e31-85b1-bc323c8896d8-kube-api-access-zmwg6\") pod \"keycloak-operator-dd84cbf46-x7b9s\" (UID: \"f83c0b5c-2c73-4e31-85b1-bc323c8896d8\") " pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" Jun 05 21:34:28.437517 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.437491 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmwg6\" (UniqueName: \"kubernetes.io/projected/f83c0b5c-2c73-4e31-85b1-bc323c8896d8-kube-api-access-zmwg6\") pod \"keycloak-operator-dd84cbf46-x7b9s\" (UID: \"f83c0b5c-2c73-4e31-85b1-bc323c8896d8\") " pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" Jun 05 21:34:28.566671 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.566622 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" Jun 05 21:34:28.696446 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.696422 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-x7b9s"] Jun 05 21:34:28.698748 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:34:28.698712 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83c0b5c_2c73_4e31_85b1_bc323c8896d8.slice/crio-c6c1c9dc4daa8276b76e18747c2a063b34f7bdd1e891067d1c43acc88e8310f6 WatchSource:0}: Error finding container c6c1c9dc4daa8276b76e18747c2a063b34f7bdd1e891067d1c43acc88e8310f6: Status 404 returned error can't find the container with id c6c1c9dc4daa8276b76e18747c2a063b34f7bdd1e891067d1c43acc88e8310f6 Jun 05 21:34:28.923579 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:28.923493 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" event={"ID":"f83c0b5c-2c73-4e31-85b1-bc323c8896d8","Type":"ContainerStarted","Data":"c6c1c9dc4daa8276b76e18747c2a063b34f7bdd1e891067d1c43acc88e8310f6"} Jun 05 21:34:33.953735 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:33.953700 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" event={"ID":"f83c0b5c-2c73-4e31-85b1-bc323c8896d8","Type":"ContainerStarted","Data":"647f1070c6e46b92607c9a660489f68de1a6a71f586d1e7c700809e799c41974"} Jun 05 21:34:33.969726 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:34:33.969677 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-x7b9s" podStartSLOduration=0.808511801 podStartE2EDuration="5.969661981s" totalImagesPullingTime="5.16115018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:34:33.968007162 +0000 UTC m=+957.204796384" watchObservedRunningTime="2026-06-05 21:34:33.969661981 +0000 UTC m=+957.206451178" Jun 05 21:35:15.447412 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:15.447330 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p4vdk"] Jun 05 21:35:15.447920 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:15.447519 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-p4vdk" podUID="6d8636da-da86-4e52-a481-28ebdb703621" containerName="authorino" containerID="cri-o://bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557" gracePeriod=30 Jun 05 21:35:15.692562 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:15.692535 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p4vdk" Jun 05 21:35:15.765152 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:15.765073 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxn5w\" (UniqueName: \"kubernetes.io/projected/6d8636da-da86-4e52-a481-28ebdb703621-kube-api-access-zxn5w\") pod \"6d8636da-da86-4e52-a481-28ebdb703621\" (UID: \"6d8636da-da86-4e52-a481-28ebdb703621\") " Jun 05 21:35:15.767056 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:15.767030 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d8636da-da86-4e52-a481-28ebdb703621-kube-api-access-zxn5w" (OuterVolumeSpecName: "kube-api-access-zxn5w") pod "6d8636da-da86-4e52-a481-28ebdb703621" (UID: "6d8636da-da86-4e52-a481-28ebdb703621"). InnerVolumeSpecName "kube-api-access-zxn5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:35:15.866659 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:15.866628 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxn5w\" (UniqueName: \"kubernetes.io/projected/6d8636da-da86-4e52-a481-28ebdb703621-kube-api-access-zxn5w\") on node \"ip-10-0-136-105.ec2.internal\" DevicePath \"\"" Jun 05 21:35:16.145696 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.145662 2567 generic.go:356] "Generic (PLEG): container finished" podID="6d8636da-da86-4e52-a481-28ebdb703621" containerID="bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557" exitCode=0 Jun 05 21:35:16.145906 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.145701 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-p4vdk" Jun 05 21:35:16.145906 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.145728 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p4vdk" event={"ID":"6d8636da-da86-4e52-a481-28ebdb703621","Type":"ContainerDied","Data":"bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557"} Jun 05 21:35:16.145906 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.145767 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-p4vdk" event={"ID":"6d8636da-da86-4e52-a481-28ebdb703621","Type":"ContainerDied","Data":"6f069e1b9977ddc4961797f770955929876b18c7f1c37bd343a00eb2459984b1"} Jun 05 21:35:16.145906 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.145788 2567 scope.go:117] "RemoveContainer" containerID="bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557" Jun 05 21:35:16.154907 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.154864 2567 scope.go:117] "RemoveContainer" containerID="bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557" Jun 05 21:35:16.155183 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:35:16.155164 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557\": container with ID starting with bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557 not found: ID does not exist" containerID="bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557" Jun 05 21:35:16.155257 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.155192 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557"} err="failed to get container status \"bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557\": rpc error: code = NotFound desc = could not find container \"bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557\": container with ID starting with bb9f96a03d4f3cb606a676d1f3dff0cde0bdf6e5be957ec7ecb524cbd4fe5557 not found: ID does not exist" Jun 05 21:35:16.165544 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.165517 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p4vdk"] Jun 05 21:35:16.167611 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:16.167588 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-p4vdk"] Jun 05 21:35:17.198355 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:17.198317 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d8636da-da86-4e52-a481-28ebdb703621" path="/var/lib/kubelet/pods/6d8636da-da86-4e52-a481-28ebdb703621/volumes" Jun 05 21:35:52.766527 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.766489 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp"] Jun 05 21:35:52.766973 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.766939 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d8636da-da86-4e52-a481-28ebdb703621" containerName="authorino" Jun 05 21:35:52.766973 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.766954 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d8636da-da86-4e52-a481-28ebdb703621" containerName="authorino" Jun 05 21:35:52.767047 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.767019 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d8636da-da86-4e52-a481-28ebdb703621" containerName="authorino" Jun 05 21:35:52.769445 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.769428 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:52.771347 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.771317 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 05 21:35:52.771486 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.771368 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-jsbl4\"" Jun 05 21:35:52.777979 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.777958 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp"] Jun 05 21:35:52.789754 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.789726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8532831-ce0b-462e-8402-a165d6c9d240-maas-api-tls\") pod \"maas-api-95dfcbcc8-qmzpp\" (UID: \"d8532831-ce0b-462e-8402-a165d6c9d240\") " pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:52.789861 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.789847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgzp\" (UniqueName: \"kubernetes.io/projected/d8532831-ce0b-462e-8402-a165d6c9d240-kube-api-access-gpgzp\") pod \"maas-api-95dfcbcc8-qmzpp\" (UID: \"d8532831-ce0b-462e-8402-a165d6c9d240\") " pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:52.890967 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.890916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgzp\" (UniqueName: \"kubernetes.io/projected/d8532831-ce0b-462e-8402-a165d6c9d240-kube-api-access-gpgzp\") pod \"maas-api-95dfcbcc8-qmzpp\" (UID: \"d8532831-ce0b-462e-8402-a165d6c9d240\") " pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:52.891140 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.891019 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8532831-ce0b-462e-8402-a165d6c9d240-maas-api-tls\") pod \"maas-api-95dfcbcc8-qmzpp\" (UID: \"d8532831-ce0b-462e-8402-a165d6c9d240\") " pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:52.891184 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:35:52.891152 2567 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 21:35:52.891250 ip-10-0-136-105 kubenswrapper[2567]: E0605 21:35:52.891238 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8532831-ce0b-462e-8402-a165d6c9d240-maas-api-tls podName:d8532831-ce0b-462e-8402-a165d6c9d240 nodeName:}" failed. No retries permitted until 2026-06-05 21:35:53.39120501 +0000 UTC m=+1036.627994194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d8532831-ce0b-462e-8402-a165d6c9d240-maas-api-tls") pod "maas-api-95dfcbcc8-qmzpp" (UID: "d8532831-ce0b-462e-8402-a165d6c9d240") : secret "maas-api-serving-cert" not found Jun 05 21:35:52.904063 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:52.904030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgzp\" (UniqueName: \"kubernetes.io/projected/d8532831-ce0b-462e-8402-a165d6c9d240-kube-api-access-gpgzp\") pod \"maas-api-95dfcbcc8-qmzpp\" (UID: \"d8532831-ce0b-462e-8402-a165d6c9d240\") " pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:53.348479 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.348444 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gzh8z"] Jun 05 21:35:53.350750 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.350733 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" Jun 05 21:35:53.352984 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.352966 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nzsss\"" Jun 05 21:35:53.354574 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.354557 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 21:35:53.364458 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.364435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gzh8z"] Jun 05 21:35:53.395806 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.395773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8532831-ce0b-462e-8402-a165d6c9d240-maas-api-tls\") pod \"maas-api-95dfcbcc8-qmzpp\" (UID: \"d8532831-ce0b-462e-8402-a165d6c9d240\") " pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:53.395991 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.395884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtxfh\" (UniqueName: \"kubernetes.io/projected/b5f15754-918f-42cf-aaff-1038e1fe5af4-kube-api-access-vtxfh\") pod \"payload-processing-7c6c859784-gzh8z\" (UID: \"b5f15754-918f-42cf-aaff-1038e1fe5af4\") " pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" Jun 05 21:35:53.398174 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.398157 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8532831-ce0b-462e-8402-a165d6c9d240-maas-api-tls\") pod \"maas-api-95dfcbcc8-qmzpp\" (UID: \"d8532831-ce0b-462e-8402-a165d6c9d240\") " pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:53.496439 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.496400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtxfh\" (UniqueName: \"kubernetes.io/projected/b5f15754-918f-42cf-aaff-1038e1fe5af4-kube-api-access-vtxfh\") pod \"payload-processing-7c6c859784-gzh8z\" (UID: \"b5f15754-918f-42cf-aaff-1038e1fe5af4\") " pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" Jun 05 21:35:53.505234 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.505214 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtxfh\" (UniqueName: \"kubernetes.io/projected/b5f15754-918f-42cf-aaff-1038e1fe5af4-kube-api-access-vtxfh\") pod \"payload-processing-7c6c859784-gzh8z\" (UID: \"b5f15754-918f-42cf-aaff-1038e1fe5af4\") " pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" Jun 05 21:35:53.661770 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.661672 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" Jun 05 21:35:53.680759 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.680724 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:53.801619 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.801546 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gzh8z"] Jun 05 21:35:53.804690 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:35:53.804655 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f15754_918f_42cf_aaff_1038e1fe5af4.slice/crio-87277a7ad0614c8bda65a338fa42efcf84579c397d9be3de6ad83ee47b802c05 WatchSource:0}: Error finding container 87277a7ad0614c8bda65a338fa42efcf84579c397d9be3de6ad83ee47b802c05: Status 404 returned error can't find the container with id 87277a7ad0614c8bda65a338fa42efcf84579c397d9be3de6ad83ee47b802c05 Jun 05 21:35:53.806782 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.806766 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:35:53.827175 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:53.827154 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp"] Jun 05 21:35:53.829689 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:35:53.829670 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8532831_ce0b_462e_8402_a165d6c9d240.slice/crio-fe64c812e3b238df4b2f77200ecff9af22e0606c24394f5ad5bf1938eaecdbf7 WatchSource:0}: Error finding container fe64c812e3b238df4b2f77200ecff9af22e0606c24394f5ad5bf1938eaecdbf7: Status 404 returned error can't find the container with id fe64c812e3b238df4b2f77200ecff9af22e0606c24394f5ad5bf1938eaecdbf7 Jun 05 21:35:54.359131 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:54.359084 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" event={"ID":"d8532831-ce0b-462e-8402-a165d6c9d240","Type":"ContainerStarted","Data":"fe64c812e3b238df4b2f77200ecff9af22e0606c24394f5ad5bf1938eaecdbf7"} Jun 05 21:35:54.360524 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:54.360494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" event={"ID":"b5f15754-918f-42cf-aaff-1038e1fe5af4","Type":"ContainerStarted","Data":"87277a7ad0614c8bda65a338fa42efcf84579c397d9be3de6ad83ee47b802c05"} Jun 05 21:35:57.381400 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:57.381302 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" event={"ID":"d8532831-ce0b-462e-8402-a165d6c9d240","Type":"ContainerStarted","Data":"80887ce0d253b61268846abc240575ccb2e4f08cb68e0c05f608156597b9ae26"} Jun 05 21:35:57.381400 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:57.381377 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:35:57.382934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:57.382902 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" event={"ID":"b5f15754-918f-42cf-aaff-1038e1fe5af4","Type":"ContainerStarted","Data":"d184724ef7799a8b89a441515a249e40a08f076e4353dfecfad781488026ebc6"} Jun 05 21:35:57.383050 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:57.382954 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" Jun 05 21:35:57.395526 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:57.395486 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" podStartSLOduration=2.130806873 podStartE2EDuration="5.395473528s" totalImagesPullingTime="3.264666655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:35:57.395422391 +0000 UTC m=+1040.632211588" watchObservedRunningTime="2026-06-05 21:35:57.395473528 +0000 UTC m=+1040.632262726" Jun 05 21:35:57.413609 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:35:57.413562 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" podStartSLOduration=1.125277233 podStartE2EDuration="4.413548128s" totalImagesPullingTime="3.288270895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:35:57.411984313 +0000 UTC m=+1040.648773510" watchObservedRunningTime="2026-06-05 21:35:57.413548128 +0000 UTC m=+1040.650337371" Jun 05 21:36:01.410776 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:01.410744 2567 generic.go:356] "Generic (PLEG): container finished" podID="03aaf96b-6488-47ef-bf4a-0fc448ab3a6a" containerID="4ae4977c4fe39b301e2c0d351562160e9ee9dbfc13981ff4b8d4251d355c978c" exitCode=0 Jun 05 21:36:01.411192 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:01.410816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" event={"ID":"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a","Type":"ContainerDied","Data":"4ae4977c4fe39b301e2c0d351562160e9ee9dbfc13981ff4b8d4251d355c978c"} Jun 05 21:36:01.411192 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:01.411188 2567 scope.go:117] "RemoveContainer" containerID="4ae4977c4fe39b301e2c0d351562160e9ee9dbfc13981ff4b8d4251d355c978c" Jun 05 21:36:01.412166 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:01.412144 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:36:01.412218 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:01.412207 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:36:01.412254 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:01.412238 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:36:01.704468 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:01.704392 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:36:02.417648 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:02.417607 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" event={"ID":"03aaf96b-6488-47ef-bf4a-0fc448ab3a6a","Type":"ContainerStarted","Data":"65345b449e585a58bdf686868ad1847657b196829055e0fae9ae5825cda01163"} Jun 05 21:36:02.992272 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:02.992235 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:36:02.993526 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:02.993501 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bldrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 05 21:36:02.993628 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:02.993549 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" podUID="03aaf96b-6488-47ef-bf4a-0fc448ab3a6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 05 21:36:03.393773 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:03.393743 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-95dfcbcc8-qmzpp" Jun 05 21:36:03.993312 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:03.993278 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bldrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 05 21:36:03.993703 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:03.993330 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" podUID="03aaf96b-6488-47ef-bf4a-0fc448ab3a6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 05 21:36:04.992476 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:04.992440 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bldrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 05 21:36:04.992662 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:04.992496 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" podUID="03aaf96b-6488-47ef-bf4a-0fc448ab3a6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 05 21:36:05.992421 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:05.992384 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bldrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 05 21:36:05.992814 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:05.992440 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" podUID="03aaf96b-6488-47ef-bf4a-0fc448ab3a6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 05 21:36:06.997091 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:06.997058 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:36:06.997479 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:06.997396 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:36:06.998046 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:06.998029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bldrv" Jun 05 21:36:08.390303 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:36:08.390273 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-gzh8z" Jun 05 21:37:16.946517 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.946482 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk"] Jun 05 21:37:16.950293 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.950274 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:16.954784 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.954760 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 21:37:16.954917 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.954818 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 21:37:16.955343 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.955326 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lbq4w\"" Jun 05 21:37:16.955392 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.955371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 05 21:37:16.967529 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.967502 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk"] Jun 05 21:37:16.981890 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.981849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:16.982012 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.981915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:16.982012 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.981942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:16.982111 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.982044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805443f9-1827-4abe-a8d0-afbfa142feb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:16.982111 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.982091 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzvp\" (UniqueName: \"kubernetes.io/projected/805443f9-1827-4abe-a8d0-afbfa142feb1-kube-api-access-zwzvp\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:16.982179 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:16.982167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.082737 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.082706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.082956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.082752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.082956 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.082846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.083092 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.083026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.083160 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.083140 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805443f9-1827-4abe-a8d0-afbfa142feb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.083215 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.083179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzvp\" (UniqueName: \"kubernetes.io/projected/805443f9-1827-4abe-a8d0-afbfa142feb1-kube-api-access-zwzvp\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.083215 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.083188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.083432 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.083219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.083432 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.083333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.085134 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.085104 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805443f9-1827-4abe-a8d0-afbfa142feb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.085538 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.085516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805443f9-1827-4abe-a8d0-afbfa142feb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.091857 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.091835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzvp\" (UniqueName: \"kubernetes.io/projected/805443f9-1827-4abe-a8d0-afbfa142feb1-kube-api-access-zwzvp\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk\" (UID: \"805443f9-1827-4abe-a8d0-afbfa142feb1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.261207 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.261116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" Jun 05 21:37:17.403271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.403245 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk"] Jun 05 21:37:17.405796 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:37:17.405750 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805443f9_1827_4abe_a8d0_afbfa142feb1.slice/crio-5240e23b51bf9f9889bfb85d316c7d949a3cb098906e7cd562cb1ff26e88a98a WatchSource:0}: Error finding container 5240e23b51bf9f9889bfb85d316c7d949a3cb098906e7cd562cb1ff26e88a98a: Status 404 returned error can't find the container with id 5240e23b51bf9f9889bfb85d316c7d949a3cb098906e7cd562cb1ff26e88a98a Jun 05 21:37:17.789178 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:17.789143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" event={"ID":"805443f9-1827-4abe-a8d0-afbfa142feb1","Type":"ContainerStarted","Data":"5240e23b51bf9f9889bfb85d316c7d949a3cb098906e7cd562cb1ff26e88a98a"} Jun 05 21:37:21.813700 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:37:21.813662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk" event={"ID":"805443f9-1827-4abe-a8d0-afbfa142feb1","Type":"ContainerStarted","Data":"3101e49f9f3ae9f4a64780f0813141e5a4d91f0b3bbb10ea66ae475dfc9cac83"} Jun 05 21:38:37.218554 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:37.218528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:38:37.221170 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:37.221150 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:38:54.996456 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:54.996419 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f857d6fdf-n6jbt_cb8ef834-06b9-415f-912f-b2fd9c14fa2e/nginx/0.log" Jun 05 21:38:55.893515 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:55.893487 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-twckb_2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0/copy-manifests/0.log" Jun 05 21:38:55.899535 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:55.899510 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-twckb_2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0/manager/0.log" Jun 05 21:38:57.193387 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:57.193345 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vpvxt_bf9b6d10-12ff-423b-91bf-231ff1025d35/manager/0.log" Jun 05 21:38:57.305161 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:57.305134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zps5c_8f076441-b5b8-4c5b-9cd2-2ae1b5267efa/manager/0.log" Jun 05 21:38:57.523336 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:57.523311 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b2l2m_fda54ce6-1e94-437c-8d61-d8c3a3c687ce/registry-server/0.log" Jun 05 21:38:58.176770 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:58.176741 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956z969_453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d/istio-proxy/0.log" Jun 05 21:38:58.608361 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:58.608330 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/1.log" Jun 05 21:38:58.819842 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:58.819812 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gzh8z_b5f15754-918f-42cf-aaff-1038e1fe5af4/payload-processing/0.log" Jun 05 21:38:59.497135 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:38:59.497104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-nr2bk_805443f9-1827-4abe-a8d0-afbfa142feb1/storage-initializer/0.log" Jun 05 21:39:06.245259 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:06.245229 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dltt6_417a4573-669e-4f5d-be23-34850c1f3f6a/global-pull-secret-syncer/0.log" Jun 05 21:39:06.391760 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:06.391733 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xsrqw_7a7dad4f-ea67-4fb0-bc36-d5186b5390cb/konnectivity-agent/0.log" Jun 05 21:39:06.460304 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:06.460278 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-105.ec2.internal_1c26ffe575f85643b72e1ed3f0552d5d/haproxy/0.log" Jun 05 21:39:11.658499 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:11.658471 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vpvxt_bf9b6d10-12ff-423b-91bf-231ff1025d35/manager/0.log" Jun 05 21:39:11.697929 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:11.697899 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zps5c_8f076441-b5b8-4c5b-9cd2-2ae1b5267efa/manager/0.log" Jun 05 21:39:11.762042 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:11.762018 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b2l2m_fda54ce6-1e94-437c-8d61-d8c3a3c687ce/registry-server/0.log" Jun 05 21:39:13.728557 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:13.728507 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-xdf72_dbfc8003-7513-4157-9e67-1954dd63fec2/cluster-monitoring-operator/0.log" Jun 05 21:39:13.827849 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:13.827821 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c44f44476-j26qp_50439b98-57b8-4ad3-a439-f7687e67f9bf/metrics-server/0.log" Jun 05 21:39:13.855139 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:13.855115 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-gqtpp_0385f27d-f89a-4442-9160-a434eed39a2f/monitoring-plugin/0.log" Jun 05 21:39:13.957029 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:13.956944 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ddhz_a744b16b-dfc3-4408-b562-ea3787d4adba/node-exporter/0.log" Jun 05 21:39:13.979552 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:13.979527 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ddhz_a744b16b-dfc3-4408-b562-ea3787d4adba/kube-rbac-proxy/0.log" Jun 05 21:39:14.007060 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.007038 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ddhz_a744b16b-dfc3-4408-b562-ea3787d4adba/init-textfile/0.log" Jun 05 21:39:14.200402 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.200370 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e47216c4-12b3-4fc7-ac21-2c77753f3335/prometheus/0.log" Jun 05 21:39:14.239163 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.239093 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e47216c4-12b3-4fc7-ac21-2c77753f3335/config-reloader/0.log" Jun 05 21:39:14.263978 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.263952 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e47216c4-12b3-4fc7-ac21-2c77753f3335/thanos-sidecar/0.log" Jun 05 21:39:14.286363 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.286338 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e47216c4-12b3-4fc7-ac21-2c77753f3335/kube-rbac-proxy-web/0.log" Jun 05 21:39:14.311723 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.311697 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e47216c4-12b3-4fc7-ac21-2c77753f3335/kube-rbac-proxy/0.log" Jun 05 21:39:14.344423 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.344397 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e47216c4-12b3-4fc7-ac21-2c77753f3335/kube-rbac-proxy-thanos/0.log" Jun 05 21:39:14.369163 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.369133 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e47216c4-12b3-4fc7-ac21-2c77753f3335/init-config-reloader/0.log" Jun 05 21:39:14.563267 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.563237 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/thanos-query/0.log" Jun 05 21:39:14.594183 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.594158 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy-web/0.log" Jun 05 21:39:14.623271 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.623248 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy/0.log" Jun 05 21:39:14.647088 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.647064 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/prom-label-proxy/0.log" Jun 05 21:39:14.668710 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.668682 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy-rules/0.log" Jun 05 21:39:14.693275 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:14.693250 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d755cc74f-kcnq4_143eaca0-f839-4760-a28e-41bfec2e58bf/kube-rbac-proxy-metrics/0.log" Jun 05 21:39:16.518613 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.518587 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/2.log" Jun 05 21:39:16.523338 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.523315 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7vnfn_e44f786a-5e1e-44c5-b17f-8238f24bd589/console-operator/3.log" Jun 05 21:39:16.789494 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.789459 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh"] Jun 05 21:39:16.793211 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.793189 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:16.795476 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.795456 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czp5f\"/\"openshift-service-ca.crt\"" Jun 05 21:39:16.795980 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.795967 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czp5f\"/\"kube-root-ca.crt\"" Jun 05 21:39:16.796052 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.795990 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-czp5f\"/\"default-dockercfg-6cfvz\"" Jun 05 21:39:16.802627 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.802601 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh"] Jun 05 21:39:16.917207 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.917170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-podres\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:16.917207 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.917207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68bwm\" (UniqueName: \"kubernetes.io/projected/f2bd4858-ee89-437b-8cc2-50c713c49f58-kube-api-access-68bwm\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:16.917460 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.917310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-sys\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:16.917460 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.917378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-proc\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:16.917460 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:16.917402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-lib-modules\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.017843 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.017809 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-podres\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.017843 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.017844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68bwm\" (UniqueName: \"kubernetes.io/projected/f2bd4858-ee89-437b-8cc2-50c713c49f58-kube-api-access-68bwm\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.018097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.017896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-sys\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.018097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.017946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-proc\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.018097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.017964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-lib-modules\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.018097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.018022 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-podres\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.018097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.018037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-sys\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.018097 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.018061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-proc\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.018291 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.018102 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2bd4858-ee89-437b-8cc2-50c713c49f58-lib-modules\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.026490 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.026464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68bwm\" (UniqueName: \"kubernetes.io/projected/f2bd4858-ee89-437b-8cc2-50c713c49f58-kube-api-access-68bwm\") pod \"perf-node-gather-daemonset-cb5zh\" (UID: \"f2bd4858-ee89-437b-8cc2-50c713c49f58\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.104527 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.104447 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.163264 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.163236 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-x58hc_611e9f75-b10e-4cf3-a84c-a74af9d7996b/download-server/0.log" Jun 05 21:39:17.239784 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.239757 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh"] Jun 05 21:39:17.242859 ip-10-0-136-105 kubenswrapper[2567]: W0605 21:39:17.242826 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf2bd4858_ee89_437b_8cc2_50c713c49f58.slice/crio-885d5ac1fcf1934efd19ee87769126cf951be293f522bc114542b64992cc7b5b WatchSource:0}: Error finding container 885d5ac1fcf1934efd19ee87769126cf951be293f522bc114542b64992cc7b5b: Status 404 returned error can't find the container with id 885d5ac1fcf1934efd19ee87769126cf951be293f522bc114542b64992cc7b5b Jun 05 21:39:17.383918 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.383811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" event={"ID":"f2bd4858-ee89-437b-8cc2-50c713c49f58","Type":"ContainerStarted","Data":"d10483a472e2fbf255adccf3a76fc6f315231ea55361ef7be07d0756ef3f1a18"} Jun 05 21:39:17.383918 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.383868 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" event={"ID":"f2bd4858-ee89-437b-8cc2-50c713c49f58","Type":"ContainerStarted","Data":"885d5ac1fcf1934efd19ee87769126cf951be293f522bc114542b64992cc7b5b"} Jun 05 21:39:17.384111 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.383923 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:17.397834 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:17.397782 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" podStartSLOduration=1.397768532 podStartE2EDuration="1.397768532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:39:17.397024131 +0000 UTC m=+1240.633813329" watchObservedRunningTime="2026-06-05 21:39:17.397768532 +0000 UTC m=+1240.634557730" Jun 05 21:39:19.032752 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:19.032722 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dlh9x_51b1c7e8-5203-44d8-855c-59832720b4dd/dns/0.log" Jun 05 21:39:19.059934 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:19.059905 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dlh9x_51b1c7e8-5203-44d8-855c-59832720b4dd/kube-rbac-proxy/0.log" Jun 05 21:39:19.199641 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:19.199611 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8zxjn_3b207abd-2216-45ce-84fe-1f49a8c0b49c/dns-node-resolver/0.log" Jun 05 21:39:19.913060 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:19.913032 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rd274_e35c1474-69c4-4617-aeba-eef3e7b9a3a9/node-ca/0.log" Jun 05 21:39:20.867087 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:20.867055 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956z969_453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d/istio-proxy/0.log" Jun 05 21:39:21.014497 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:21.014466 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/1.log" Jun 05 21:39:21.014717 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:21.014660 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/0.log" Jun 05 21:39:21.074210 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:21.074184 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gzh8z_b5f15754-918f-42cf-aaff-1038e1fe5af4/payload-processing/0.log" Jun 05 21:39:21.770442 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:21.770414 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ghwzl_b9f552dd-786d-49ac-b51b-5987fc28c830/serve-healthcheck-canary/0.log" Jun 05 21:39:22.362355 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:22.362327 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rjgk_c3835afd-8e1e-49b3-8ff6-39de7f313375/kube-rbac-proxy/0.log" Jun 05 21:39:22.390770 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:22.390743 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rjgk_c3835afd-8e1e-49b3-8ff6-39de7f313375/exporter/0.log" Jun 05 21:39:22.417076 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:22.417053 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2rjgk_c3835afd-8e1e-49b3-8ff6-39de7f313375/extractor/0.log" Jun 05 21:39:23.399810 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:23.399784 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-cb5zh" Jun 05 21:39:24.849603 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:24.849574 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f857d6fdf-n6jbt_cb8ef834-06b9-415f-912f-b2fd9c14fa2e/nginx/0.log" Jun 05 21:39:25.212699 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:25.212618 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-twckb_2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0/manager/0.log" Jun 05 21:39:25.238421 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:25.238395 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-twckb_2b534fdb-70d1-4a4e-8aef-5b11ce1e3bc0/copy-manifests/0.log" Jun 05 21:39:26.837554 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:26.837524 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c554fd75b-m4pjw_07e7c9af-2171-4208-8a25-d286c7d1edf9/manager/0.log" Jun 05 21:39:31.127047 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:31.127006 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956z969_453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d/istio-proxy/0.log" Jun 05 21:39:31.248045 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:31.247975 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/1.log" Jun 05 21:39:31.248185 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:31.248111 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/0.log" Jun 05 21:39:31.282526 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:31.282497 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gzh8z_b5f15754-918f-42cf-aaff-1038e1fe5af4/payload-processing/0.log" Jun 05 21:39:32.356834 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:32.356807 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-pxw2b_69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff/migrator/0.log" Jun 05 21:39:32.382431 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:32.382395 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-pxw2b_69e0dc9d-42b9-4878-9a3e-d8ddc8d030ff/graceful-termination/0.log" Jun 05 21:39:32.498846 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:32.498818 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956z969_453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d/istio-proxy/0.log" Jun 05 21:39:32.584190 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:32.584159 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/1.log" Jun 05 21:39:32.584361 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:32.584327 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/0.log" Jun 05 21:39:32.613471 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:32.613403 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gzh8z_b5f15754-918f-42cf-aaff-1038e1fe5af4/payload-processing/0.log" Jun 05 21:39:34.142747 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.142721 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcd9q_f25d1d01-7c8a-4027-b3a9-f661cddcc337/kube-multus-additional-cni-plugins/0.log" Jun 05 21:39:34.167259 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.167235 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcd9q_f25d1d01-7c8a-4027-b3a9-f661cddcc337/egress-router-binary-copy/0.log" Jun 05 21:39:34.192329 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.192307 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcd9q_f25d1d01-7c8a-4027-b3a9-f661cddcc337/cni-plugins/0.log" Jun 05 21:39:34.218515 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.218485 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcd9q_f25d1d01-7c8a-4027-b3a9-f661cddcc337/bond-cni-plugin/0.log" Jun 05 21:39:34.242448 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.242418 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcd9q_f25d1d01-7c8a-4027-b3a9-f661cddcc337/routeoverride-cni/0.log" Jun 05 21:39:34.264351 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.264325 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcd9q_f25d1d01-7c8a-4027-b3a9-f661cddcc337/whereabouts-cni-bincopy/0.log" Jun 05 21:39:34.287195 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.287172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hcd9q_f25d1d01-7c8a-4027-b3a9-f661cddcc337/whereabouts-cni/0.log" Jun 05 21:39:34.319044 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.319020 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97956z969_453a7f93-8b7a-4d7a-bae5-30b7b32fdb8d/istio-proxy/0.log" Jun 05 21:39:34.398990 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.398868 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/1.log" Jun 05 21:39:34.399141 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.399022 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bldrv_03aaf96b-6488-47ef-bf4a-0fc448ab3a6a/istio-proxy/0.log" Jun 05 21:39:34.422057 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.422031 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gzh8z_b5f15754-918f-42cf-aaff-1038e1fe5af4/payload-processing/0.log" Jun 05 21:39:34.695411 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.695332 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q2h5v_93658f8a-391e-436b-9a72-da92ddd67add/kube-multus/0.log" Jun 05 21:39:34.769296 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.769264 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbkgz_0a279011-45a7-449c-9754-a20d1c0d3f00/network-metrics-daemon/0.log" Jun 05 21:39:34.791965 ip-10-0-136-105 kubenswrapper[2567]: I0605 21:39:34.791937 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbkgz_0a279011-45a7-449c-9754-a20d1c0d3f00/kube-rbac-proxy/0.log"