Jun 12 18:42:22.719610 ip-10-0-129-145 systemd[1]: Starting Kubernetes Kubelet... Jun 12 18:42:23.099082 ip-10-0-129-145 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:42:23.099082 ip-10-0-129-145 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 18:42:23.099082 ip-10-0-129-145 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:42:23.099082 ip-10-0-129-145 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 18:42:23.099082 ip-10-0-129-145 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:42:23.099778 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.099693 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 18:42:23.104228 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104211 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:23.104228 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104228 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104232 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104235 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104238 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104242 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104244 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104249 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104252 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104254 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104257 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104260 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104264 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104268 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104271 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104274 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104277 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104280 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104295 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104298 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:23.104311 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104301 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104304 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104307 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104315 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104319 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104322 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104325 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104328 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104330 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104333 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104336 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104338 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104341 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104343 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104346 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104348 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104351 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104353 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104356 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104358 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:23.104765 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104361 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104363 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104365 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104368 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104370 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104373 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104375 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104378 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104380 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104383 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104386 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104389 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104391 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104394 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104398 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104401 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104404 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104406 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104409 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104411 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:23.105245 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104414 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104416 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104419 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104421 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104424 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104426 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104429 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104432 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104435 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104439 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104443 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104447 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104449 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104452 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104455 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104457 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104461 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104464 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104467 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:23.105788 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104470 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104473 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104476 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104478 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104481 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104483 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104486 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104490 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104492 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104495 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104498 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104501 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104503 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104506 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104508 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104511 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104513 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104516 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104518 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.104521 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:23.106239 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105258 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105265 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105268 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105271 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105275 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105278 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105296 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105300 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105302 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105305 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105308 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105311 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105314 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105317 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105319 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105322 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105325 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105328 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105330 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105333 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:23.106745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105336 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105338 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105341 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105344 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105346 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105349 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105352 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105354 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105357 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105360 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105362 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105365 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105368 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105370 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105373 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105375 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105379 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105383 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105387 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105390 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:23.107243 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105392 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105395 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105398 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105401 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105404 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105407 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105409 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105412 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105415 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105417 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105420 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105423 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105426 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105429 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105431 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105434 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105437 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105439 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105442 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:23.107745 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105444 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105447 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105450 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105453 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105455 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105458 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105460 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105462 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105465 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105468 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105470 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105475 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105479 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105483 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105486 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105489 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105492 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105494 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105497 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:23.108215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105500 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105502 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105505 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105508 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105510 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105512 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105515 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105518 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105520 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105523 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105525 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105528 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105531 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105533 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105536 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105538 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105541 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105543 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105546 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105548 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:23.108704 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105551 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105944 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105949 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105952 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105955 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105958 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105961 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105964 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105972 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105976 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105978 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105981 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105983 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105986 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105989 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105992 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105994 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105997 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.105999 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106002 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:23.109183 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106004 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106007 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106009 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106012 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106015 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106017 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106020 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106022 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106024 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106027 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106029 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106032 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106034 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106036 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106039 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106042 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106044 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106047 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106050 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106052 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:23.109679 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106057 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106061 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106065 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106068 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106071 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106074 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106077 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106079 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106082 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106084 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106087 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106090 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106092 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106095 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106097 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106100 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106102 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106105 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106107 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:23.110161 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106110 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106112 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106115 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106119 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106125 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106128 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106131 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106134 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106137 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106139 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106142 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106144 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106153 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106157 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106159 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106163 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106166 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106169 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106172 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:23.110688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106175 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106178 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106180 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106183 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106186 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106188 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106190 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106193 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106195 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106198 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106200 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106203 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106205 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106208 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106211 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106213 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106215 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106219 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106222 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106224 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:23.111157 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106227 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106229 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106320 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106328 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106335 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106339 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106354 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106358 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106362 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106366 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106369 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106373 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106376 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106379 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106382 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106385 2574 flags.go:64] FLAG: --cgroup-root="" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106388 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106391 2574 flags.go:64] FLAG: --client-ca-file="" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106393 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106397 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106403 2574 flags.go:64] FLAG: --cluster-domain="" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106406 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106409 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106412 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 18:42:23.111661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106415 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106419 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106422 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106425 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106429 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106433 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106437 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106440 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106443 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106446 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106450 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106453 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106456 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106459 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106462 2574 flags.go:64] FLAG: --enable-server="true" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106467 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106472 2574 flags.go:64] FLAG: --event-burst="100" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106475 2574 flags.go:64] FLAG: --event-qps="50" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106478 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106481 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106484 2574 flags.go:64] FLAG: --eviction-hard="" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106487 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106490 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106493 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106496 2574 flags.go:64] FLAG: --eviction-soft="" Jun 12 18:42:23.112228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106499 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106502 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106505 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106507 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106510 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106513 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106516 2574 flags.go:64] FLAG: --feature-gates="" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106520 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106523 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106526 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106529 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106532 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106537 2574 flags.go:64] FLAG: --help="false" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106540 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106543 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106546 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106549 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106552 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106555 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106558 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106561 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106564 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106567 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 18:42:23.112920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106588 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106592 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106595 2574 flags.go:64] FLAG: --kube-reserved="" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106598 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106601 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106604 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106607 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106610 2574 flags.go:64] FLAG: --lock-file="" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106613 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106616 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106619 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106624 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106627 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106630 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106633 2574 flags.go:64] FLAG: --logging-format="text" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106636 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106639 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106642 2574 flags.go:64] FLAG: --manifest-url="" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106645 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106653 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106656 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106662 2574 flags.go:64] FLAG: --max-pods="110" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106665 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106668 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106671 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 18:42:23.113540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106674 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106677 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106680 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106683 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106690 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106693 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106696 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106700 2574 flags.go:64] FLAG: --pod-cidr="" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106703 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106709 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106712 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106715 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106718 2574 flags.go:64] FLAG: --port="10250" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106721 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106723 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d8244b5b08e5e158" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106727 2574 flags.go:64] FLAG: --qos-reserved="" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106730 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106732 2574 flags.go:64] FLAG: --register-node="true" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106735 2574 flags.go:64] FLAG: --register-with-taints="" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106739 2574 flags.go:64] FLAG: --registry-burst="10" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106741 2574 flags.go:64] FLAG: --registry-qps="5" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106744 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106747 2574 flags.go:64] FLAG: --reserved-memory="" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106751 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106754 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 18:42:23.114181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106757 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106760 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106763 2574 flags.go:64] FLAG: --runonce="false" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106766 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106769 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106772 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106775 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106778 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106781 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106784 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106787 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106791 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106794 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106797 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106799 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106802 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106806 2574 flags.go:64] FLAG: --system-cgroups="" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106808 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106814 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106817 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106819 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106823 2574 flags.go:64] FLAG: --tls-min-version="" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106826 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106829 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106831 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 18:42:23.114809 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106834 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106837 2574 flags.go:64] FLAG: --v="2" Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106840 2574 flags.go:64] FLAG: --version="false" Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106844 2574 flags.go:64] FLAG: --vmodule="" Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106848 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.106851 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106966 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106969 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106972 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106975 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106979 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106983 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106986 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106988 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106991 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106994 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106996 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.106999 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107004 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107008 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107011 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:23.115426 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107014 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107017 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107020 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107023 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107026 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107029 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107031 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107034 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107036 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107039 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107042 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107044 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107047 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107050 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107052 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107055 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107057 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107060 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107063 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107065 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:23.115928 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107068 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107072 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107075 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107078 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107081 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107084 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107086 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107089 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107091 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107096 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107098 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107101 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107104 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107106 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107109 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107111 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107114 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107117 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107119 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:23.116441 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107122 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107124 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107126 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107129 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107131 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107134 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107136 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107139 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107141 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107144 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107146 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107149 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107151 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107154 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107156 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107159 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107161 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107164 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107166 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:23.116899 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107169 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107171 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107174 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107178 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107180 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107183 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107186 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107189 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107191 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107194 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107196 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107199 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107202 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107205 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107207 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107210 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107212 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107214 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107217 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107219 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:23.117374 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107222 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107224 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107227 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107229 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107234 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.107236 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.107244 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.114540 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.114658 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.114680 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.114689 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114756 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114762 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114765 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114768 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:23.117869 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114772 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114775 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114778 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114781 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114784 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114787 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114789 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114792 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114802 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114805 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114808 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114810 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114813 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114816 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114819 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114822 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114824 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114827 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114830 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114832 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114835 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:23.118236 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114838 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114847 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114849 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114852 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114854 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114857 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114859 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114862 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114864 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114868 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114872 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114875 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114878 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114880 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114882 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114885 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114887 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114905 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114912 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:23.118764 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114916 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114924 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114927 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114930 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114932 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114935 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114937 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114941 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114945 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114947 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114950 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114953 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114955 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114958 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114961 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114964 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114966 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114968 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114971 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:23.119229 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114974 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114977 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114979 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114982 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114986 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114989 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114992 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114994 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114997 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.114999 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115002 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115004 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115007 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115009 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115012 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115019 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115022 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115025 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115027 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115029 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:23.119735 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115032 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115034 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115036 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115039 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115041 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115044 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115046 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115049 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115052 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115054 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115056 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115059 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115061 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115064 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115067 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:23.120215 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115069 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.115074 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115223 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115227 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115230 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115233 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115235 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115238 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115240 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115243 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115245 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115248 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115250 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115258 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115261 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:42:23.120688 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115263 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115266 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115268 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115271 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115273 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115276 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115278 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115295 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115300 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115304 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115308 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115311 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115313 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115316 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115318 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115321 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115323 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115326 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115329 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115331 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:42:23.121054 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115334 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115337 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115339 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115341 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115344 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115346 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115348 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115351 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115353 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115356 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115358 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115367 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115370 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115373 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115376 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115378 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115381 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115383 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115386 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:42:23.121549 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115388 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115391 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115393 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115397 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115400 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115404 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115408 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115410 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115413 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115416 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115419 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115421 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115423 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115426 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115429 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115432 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115436 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115440 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:42:23.122007 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115444 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115447 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115450 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115453 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115455 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115458 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115461 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115471 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115474 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115476 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115479 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115482 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115484 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115487 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115489 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115491 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115494 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115497 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115500 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115502 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115505 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:42:23.122505 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115507 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115510 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115512 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115515 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115517 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115520 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115522 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:23.115525 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.115530 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.115646 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.117991 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.119633 2574 server.go:1019] "Starting client certificate rotation" Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.119740 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:42:23.123364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.119783 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:42:23.123893 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.122101 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:42:23.125603 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.125577 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:42:23.136105 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.136084 2574 log.go:25] "Validated CRI v1 runtime API" Jun 12 18:42:23.140298 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.140266 2574 log.go:25] "Validated CRI v1 image API" Jun 12 18:42:23.141530 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.141516 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 18:42:23.143804 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.143782 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87980e8c-f1b3-4e9b-97b2-ef8d7d200917:/dev/nvme0n1p3 a85a8f9d-2503-47f0-857a-e1db7e930bc0:/dev/nvme0n1p4] Jun 12 18:42:23.143860 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.143805 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 18:42:23.149026 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.148906 2574 manager.go:216] Machine: {Timestamp:2026-06-12 18:42:23.147752907 +0000 UTC m=+0.314147060 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100713 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec271b3140916fd166e3a9902b25586f SystemUUID:ec271b31-4091-6fd1-66e3-a9902b25586f BootID:4ea2536c-78fc-4ef9-812c-0c65e87ed33a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:1a:f5:de:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:1a:f5:de:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:25:2c:45:0b:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 18:42:23.149026 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.149023 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 18:42:23.149169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.149157 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 18:42:23.152016 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.151989 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 18:42:23.152179 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.152019 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 18:42:23.152489 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.152474 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:42:23.152800 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.152788 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 18:42:23.152835 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.152803 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 18:42:23.152835 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.152817 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:42:23.153491 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.153481 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:42:23.155590 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.155578 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 18:42:23.158914 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.158897 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:42:23.159031 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159022 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 18:42:23.159077 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159053 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 12 18:42:23.159077 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159068 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 18:42:23.159154 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159083 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 18:42:23.159154 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159092 2574 kubelet.go:398] "Adding apiserver pod source" Jun 12 18:42:23.159154 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159104 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 18:42:23.159534 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159520 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:42:23.159579 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.159545 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:42:23.163303 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.163268 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 18:42:23.165005 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.164987 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 18:42:23.165091 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165026 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 18:42:23.165254 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165240 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 18:42:23.165330 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165260 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 18:42:23.165330 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165269 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 18:42:23.165330 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165278 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 18:42:23.165330 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165306 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 18:42:23.165330 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165315 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 18:42:23.165749 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165739 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 18:42:23.165808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165752 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 18:42:23.165808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165765 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 18:42:23.165808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165774 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 18:42:23.165808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165787 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 18:42:23.165808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.165799 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 18:42:23.166567 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.166555 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 18:42:23.166567 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.166576 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 18:42:23.168155 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.168135 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 18:42:23.168516 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.168493 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 18:42:23.168596 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.168510 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 18:42:23.169902 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.169872 2574 server.go:1268] "Started kubelet" Jun 12 18:42:23.170001 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.169947 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 18:42:23.170045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.170001 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 18:42:23.170045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.170026 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 18:42:23.170794 ip-10-0-129-145 systemd[1]: Started Kubernetes Kubelet. Jun 12 18:42:23.172243 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.172225 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 12 18:42:23.174853 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.174835 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 18:42:23.175078 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.174297 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-145.ec2.internal.18b869956faf65a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-145.ec2.internal,UID:ip-10-0-129-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-145.ec2.internal,},FirstTimestamp:2026-06-12 18:42:23.169840549 +0000 UTC m=+0.336234702,LastTimestamp:2026-06-12 18:42:23.169840549 +0000 UTC m=+0.336234702,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-145.ec2.internal,}" Jun 12 18:42:23.176929 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.176907 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 18:42:23.179411 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.179394 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gtsmx" Jun 12 18:42:23.179681 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.179664 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 18:42:23.179750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.179714 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 18:42:23.179792 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.179753 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.180361 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.180317 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 18:42:23.180444 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.180368 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 18:42:23.180444 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.180380 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 18:42:23.180536 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.180512 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 12 18:42:23.180536 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.180519 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 12 18:42:23.181445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.180856 2574 factory.go:55] Registering systemd factory Jun 12 18:42:23.181445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.180872 2574 factory.go:223] Registration of the systemd container factory successfully Jun 12 18:42:23.181445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.181133 2574 factory.go:153] Registering CRI-O factory Jun 12 18:42:23.181445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.181144 2574 factory.go:223] Registration of the crio container factory successfully Jun 12 18:42:23.181445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.181211 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 18:42:23.181445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.181238 2574 factory.go:103] Registering Raw factory Jun 12 18:42:23.181445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.181252 2574 manager.go:1196] Started watching for new ooms in manager Jun 12 18:42:23.181785 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.181733 2574 manager.go:349] Starting recovery of all containers Jun 12 18:42:23.185312 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.185265 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gtsmx" Jun 12 18:42:23.190349 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.190316 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 18:42:23.190494 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.190463 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 18:42:23.193278 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.193259 2574 manager.go:354] Recovery completed Jun 12 18:42:23.198373 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.198356 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:23.200321 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.200298 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:23.200408 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.200336 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:23.200408 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.200347 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:23.200808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.200794 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 18:42:23.200808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.200806 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 18:42:23.200940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.200822 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:42:23.200940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.200864 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:23.201627 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.201608 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:23.201697 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.201648 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:23.201697 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.201660 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:23.201961 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.201940 2574 policy_none.go:49] "None policy: Start" Jun 12 18:42:23.201961 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.201954 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 18:42:23.202062 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.201964 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 18:42:23.203210 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.203199 2574 policy_none.go:47] "Start" Jun 12 18:42:23.241981 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.241957 2574 manager.go:337] "Starting Device Plugin manager" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.241994 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.242004 2574 server.go:87] "Starting device plugin registration server" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.242298 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.242313 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.242402 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.242597 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.242610 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.243314 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.243371 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.248347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.247389 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 18:42:23.248750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.248576 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 18:42:23.248750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.248624 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 18:42:23.248750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.248650 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 18:42:23.248750 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.248733 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 18:42:23.251182 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.251163 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:23.343377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.343334 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:23.344585 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.344564 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:23.344670 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.344603 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:23.344670 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.344615 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:23.344670 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.344642 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.349631 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.349583 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"] Jun 12 18:42:23.349674 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.349656 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:23.350517 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.350500 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:23.350632 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.350525 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.350632 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.350533 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:23.350632 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.350547 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:23.350632 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.350545 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-145.ec2.internal\": node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.352623 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.352606 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:23.352763 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.352738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.352813 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.352780 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:23.353383 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.353362 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:23.353448 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.353388 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:23.353448 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.353400 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:23.353861 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.353842 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:23.353924 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.353874 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:23.353924 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.353893 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:23.356104 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.356087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.356183 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.356122 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:42:23.356810 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.356795 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:42:23.356879 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.356820 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:42:23.356879 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.356828 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:42:23.368477 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.368459 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.374973 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.374945 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-145.ec2.internal\" not found" node="ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.379153 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.379134 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-145.ec2.internal\" not found" node="ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.469320 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.469271 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.481643 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.481619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5f57386a7aab263f3254ec2336712d8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-145.ec2.internal\" (UID: \"f5f57386a7aab263f3254ec2336712d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.481746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.481662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c72eb59462b1ba0026bd9450808ba0f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"c72eb59462b1ba0026bd9450808ba0f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.481746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.481700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72eb59462b1ba0026bd9450808ba0f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"c72eb59462b1ba0026bd9450808ba0f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.569974 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.569942 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.582349 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.582324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c72eb59462b1ba0026bd9450808ba0f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"c72eb59462b1ba0026bd9450808ba0f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.582421 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.582355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72eb59462b1ba0026bd9450808ba0f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"c72eb59462b1ba0026bd9450808ba0f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.582421 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.582383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5f57386a7aab263f3254ec2336712d8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-145.ec2.internal\" (UID: \"f5f57386a7aab263f3254ec2336712d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.582519 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.582422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c72eb59462b1ba0026bd9450808ba0f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"c72eb59462b1ba0026bd9450808ba0f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.582519 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.582441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c72eb59462b1ba0026bd9450808ba0f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal\" (UID: \"c72eb59462b1ba0026bd9450808ba0f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.582519 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.582504 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f5f57386a7aab263f3254ec2336712d8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-145.ec2.internal\" (UID: \"f5f57386a7aab263f3254ec2336712d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.670819 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.670787 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.677971 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.677944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.683057 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:23.683036 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" Jun 12 18:42:23.771934 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.771889 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.872512 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.872479 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:23.972979 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:23.972899 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.042883 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.042840 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:24.073999 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.073348 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.119392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.119356 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 18:42:24.120072 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.119518 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:42:24.120072 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.119519 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:42:24.173588 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.173560 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.190931 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.190887 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 18:37:23 +0000 UTC" deadline="2028-01-07 10:32:07.804723626 +0000 UTC" Jun 12 18:42:24.190931 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.190925 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13767h49m43.613803014s" Jun 12 18:42:24.206724 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:24.206314 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f57386a7aab263f3254ec2336712d8.slice/crio-59a903b3fe3776d013ec21a3f6b611fa8bab606aea70ba3fddeac12fdfe5773e WatchSource:0}: Error finding container 59a903b3fe3776d013ec21a3f6b611fa8bab606aea70ba3fddeac12fdfe5773e: Status 404 returned error can't find the container with id 59a903b3fe3776d013ec21a3f6b611fa8bab606aea70ba3fddeac12fdfe5773e Jun 12 18:42:24.206891 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:24.206809 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72eb59462b1ba0026bd9450808ba0f9.slice/crio-77ce6bb8a33c060b34ace8767bd1ea6befb26bc8165e5995d3db0dcf0a702eb7 WatchSource:0}: Error finding container 77ce6bb8a33c060b34ace8767bd1ea6befb26bc8165e5995d3db0dcf0a702eb7: Status 404 returned error can't find the container with id 77ce6bb8a33c060b34ace8767bd1ea6befb26bc8165e5995d3db0dcf0a702eb7 Jun 12 18:42:24.212511 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.212495 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:42:24.252356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.252225 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" event={"ID":"f5f57386a7aab263f3254ec2336712d8","Type":"ContainerStarted","Data":"59a903b3fe3776d013ec21a3f6b611fa8bab606aea70ba3fddeac12fdfe5773e"} Jun 12 18:42:24.253373 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.253349 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" event={"ID":"c72eb59462b1ba0026bd9450808ba0f9","Type":"ContainerStarted","Data":"77ce6bb8a33c060b34ace8767bd1ea6befb26bc8165e5995d3db0dcf0a702eb7"} Jun 12 18:42:24.274556 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.274528 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.301478 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:24.301451 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:24.375531 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.375503 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.476053 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.476020 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.576683 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.576596 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.677396 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.677350 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.777859 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.777824 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.878605 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.878550 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:24.979183 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:24.979149 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:25.079761 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.079715 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-145.ec2.internal\" not found" Jun 12 18:42:25.083401 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.083371 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:25.123383 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.123352 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:25.160728 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.160635 2574 apiserver.go:52] "Watching apiserver" Jun 12 18:42:25.169711 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.169683 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 18:42:25.170083 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.170053 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt","openshift-cluster-node-tuning-operator/tuned-hc5bm","openshift-multus/multus-additional-cni-plugins-mw92f","openshift-multus/multus-z6zzh","openshift-ovn-kubernetes/ovnkube-node-z7hqw","kube-system/global-pull-secret-syncer-cb2mv","kube-system/konnectivity-agent-qpswc","openshift-dns/node-resolver-bdd45","openshift-image-registry/node-ca-czvqp","openshift-multus/network-metrics-daemon-zrm78","openshift-network-diagnostics/network-check-target-pc96t","openshift-network-operator/iptables-alerter-4jw24"] Jun 12 18:42:25.172535 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.172514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.174644 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.174624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.175143 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.175126 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 18:42:25.175143 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.175134 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 18:42:25.175359 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.175338 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 18:42:25.175476 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.175344 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wgxs8\"" Jun 12 18:42:25.177043 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.176848 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.177043 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.176935 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lggkz\"" Jun 12 18:42:25.177219 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.177191 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:42:25.177343 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.177195 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 18:42:25.179049 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179021 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.179401 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179383 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 18:42:25.179489 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179385 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9j8b2\"" Jun 12 18:42:25.179737 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179721 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 18:42:25.179815 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179744 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 18:42:25.179815 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179790 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 18:42:25.179919 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179746 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 18:42:25.179985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179930 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" Jun 12 18:42:25.180033 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.179931 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 18:42:25.181374 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.181350 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.181482 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.181390 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qhbfb\"" Jun 12 18:42:25.181543 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.181391 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 18:42:25.183713 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.183693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.183812 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.183781 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:25.183903 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.183818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 18:42:25.184337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.184062 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 18:42:25.184337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.184071 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 18:42:25.184337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.184136 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xdv8r\"" Jun 12 18:42:25.184337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.184230 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 18:42:25.185416 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.185337 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 18:42:25.185535 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.185445 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 18:42:25.188884 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.188867 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.191321 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191301 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.191656 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-tmp\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.191742 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-system-cni-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.191742 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-k8s-cni-cncf-io\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.191742 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6blxc\" (UniqueName: \"kubernetes.io/projected/4edd7f24-219e-4ecf-9376-30176c5d0e79-kube-api-access-6blxc\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.191896 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kmkg\" (UniqueName: \"kubernetes.io/projected/2df4d50c-b902-4b5b-b038-7ae915d02ce6-kube-api-access-2kmkg\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.191896 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysctl-conf\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.191896 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-systemd\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.191896 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191822 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-os-release\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.191896 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191883 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 18:42:25.191896 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191889 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-etc-kubernetes\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191950 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-device-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-cni-multus\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192004 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tfd57\"" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.191998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-log-socket\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192033 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-cni-netd\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-registration-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-kubernetes\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lmh\" (UniqueName: \"kubernetes.io/projected/fff23fb8-4ee0-4558-8324-907b4d02a3e8-kube-api-access-h2lmh\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-kubelet\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-ovn\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192165 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovnkube-config\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-env-overrides\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96519635-dda3-4b18-9630-97116a6ec75b-cni-binary-copy\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-cni-bin\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovn-node-metrics-cert\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-run\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192385 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-sys\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-etc-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-cni-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96519635-dda3-4b18-9630-97116a6ec75b-multus-daemon-config\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s7b7\" (UniqueName: \"kubernetes.io/projected/96519635-dda3-4b18-9630-97116a6ec75b-kube-api-access-8s7b7\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.192703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-conf-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-multus-certs\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-sys-fs\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-socket-dir-parent\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-hostroot\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192923 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-kubelet\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.192939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-systemd-units\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-slash\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-netns\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-run-netns\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-systemd\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovnkube-script-lib\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-host\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.193462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-system-cni-dir\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cnibin\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-var-lib-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-modprobe-d\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysconfig\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysctl-d\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-lib-modules\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26fsl\" (UniqueName: \"kubernetes.io/projected/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-kube-api-access-26fsl\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-node-log\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-tuned\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193570 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-cnibin\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193640 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-os-release\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-cni-bin\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-socket-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-var-lib-kubelet\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193768 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193808 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4zjsh\"" Jun 12 18:42:25.194169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.193890 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:42:25.194931 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.194087 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" Jun 12 18:42:25.194931 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.194156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.196304 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.196257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:25.196747 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.196502 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:25.196747 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.196659 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 18:42:25.196929 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.196748 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 18:42:25.196929 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.196848 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rplwc\"" Jun 12 18:42:25.197038 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.196952 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 18:42:25.198521 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.198504 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:25.198647 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.198608 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:25.200888 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.200868 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal"] Jun 12 18:42:25.200980 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.200962 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.202447 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.202429 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:42:25.202669 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.202650 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal"] Jun 12 18:42:25.203675 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.203656 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 18:42:25.203815 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.203799 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 18:42:25.203892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.203816 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsrfh\"" Jun 12 18:42:25.203892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.203846 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:42:25.212563 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.212545 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h74wk" Jun 12 18:42:25.220058 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.220040 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h74wk" Jun 12 18:42:25.281703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.281674 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 18:42:25.294103 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294035 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-os-release\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.294103 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-cni-bin\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-socket-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-var-lib-kubelet\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-tmp\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-system-cni-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-os-release\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-system-cni-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-var-lib-kubelet\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.294370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294334 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-cni-bin\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-socket-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294422 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-k8s-cni-cncf-io\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6blxc\" (UniqueName: \"kubernetes.io/projected/4edd7f24-219e-4ecf-9376-30176c5d0e79-kube-api-access-6blxc\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kmkg\" (UniqueName: \"kubernetes.io/projected/2df4d50c-b902-4b5b-b038-7ae915d02ce6-kube-api-access-2kmkg\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysctl-conf\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-systemd\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-os-release\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294603 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-os-release\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.294746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294708 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysctl-conf\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-k8s-cni-cncf-io\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-etc-kubernetes\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-systemd\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.294992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-device-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-cni-multus\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-device-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295014 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-etc-kubernetes\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-log-socket\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295078 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-cni-multus\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-cni-netd\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffd37509-b8ff-4538-af18-a925ba1bb75f-serviceca\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-log-socket\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295169 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-cni-netd\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-registration-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-kubernetes\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lmh\" (UniqueName: \"kubernetes.io/projected/fff23fb8-4ee0-4558-8324-907b4d02a3e8-kube-api-access-h2lmh\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295336 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-registration-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-kubernetes\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-kubelet\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-var-lib-kubelet\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-ovn\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovnkube-config\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295415 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-ovn\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-env-overrides\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96519635-dda3-4b18-9630-97116a6ec75b-cni-binary-copy\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-cni-bin\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovn-node-metrics-cert\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.295864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56808c34-a0b6-4720-b5a3-07cbbc792669-iptables-alerter-script\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295634 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-run\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-sys\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-etc-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd46d5fa-ce73-485b-b729-4be45deaf694-kubelet-config\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef686d13-2ae1-4214-b106-af9b65a6d82d-hosts-file\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56808c34-a0b6-4720-b5a3-07cbbc792669-host-slash\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfzd\" (UniqueName: \"kubernetes.io/projected/56808c34-a0b6-4720-b5a3-07cbbc792669-kube-api-access-rkfzd\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-env-overrides\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-cni-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.295976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96519635-dda3-4b18-9630-97116a6ec75b-multus-daemon-config\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovnkube-config\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.296650 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-run\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296059 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-etc-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96519635-dda3-4b18-9630-97116a6ec75b-cni-binary-copy\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296111 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-cni-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s7b7\" (UniqueName: \"kubernetes.io/projected/96519635-dda3-4b18-9630-97116a6ec75b-kube-api-access-8s7b7\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtg9p\" (UniqueName: \"kubernetes.io/projected/ffd37509-b8ff-4538-af18-a925ba1bb75f-kube-api-access-jtg9p\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-sys\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-conf-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-multus-certs\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-cni-bin\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-sys-fs\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296275 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-conf-dir\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-multus-certs\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.297449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-socket-dir-parent\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296409 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-sys-fs\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-multus-socket-dir-parent\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296455 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cff61510-503c-4955-b1e2-9c6a80d24e8e-konnectivity-ca\") pod \"konnectivity-agent-qpswc\" (UID: \"cff61510-503c-4955-b1e2-9c6a80d24e8e\") " pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktbt8\" (UniqueName: \"kubernetes.io/projected/ef686d13-2ae1-4214-b106-af9b65a6d82d-kube-api-access-ktbt8\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296502 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-hostroot\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df4d50c-b902-4b5b-b038-7ae915d02ce6-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-kubelet\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96519635-dda3-4b18-9630-97116a6ec75b-multus-daemon-config\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-systemd-units\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-hostroot\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-systemd-units\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-slash\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296664 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-kubelet\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.298235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-slash\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cff61510-503c-4955-b1e2-9c6a80d24e8e-agent-certs\") pod \"konnectivity-agent-qpswc\" (UID: \"cff61510-503c-4955-b1e2-9c6a80d24e8e\") " pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-netns\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-run-netns\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-host-run-netns\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-systemd\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296798 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-run-netns\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296802 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovnkube-script-lib\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-host\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296835 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-run-systemd\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-system-cni-dir\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cnibin\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-system-cni-dir\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296902 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-host\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-var-lib-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fff23fb8-4ee0-4558-8324-907b4d02a3e8-cnibin\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-modprobe-d\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd46d5fa-ce73-485b-b729-4be45deaf694-dbus\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.296989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-var-lib-openvswitch\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef686d13-2ae1-4214-b106-af9b65a6d82d-tmp-dir\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysconfig\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysctl-d\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-lib-modules\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26fsl\" (UniqueName: \"kubernetes.io/projected/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-kube-api-access-26fsl\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297149 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-node-log\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297203 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffd37509-b8ff-4538-af18-a925ba1bb75f-host\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysconfig\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297080 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-modprobe-d\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh4f2\" (UniqueName: \"kubernetes.io/projected/b127fdb1-7fb1-457b-b4f1-2906e66966da-kube-api-access-rh4f2\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297277 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.299940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297307 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovnkube-script-lib\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-tuned\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297342 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-lib-modules\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-cnibin\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96519635-dda3-4b18-9630-97116a6ec75b-cnibin\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4edd7f24-219e-4ecf-9376-30176c5d0e79-node-log\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.297639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-sysctl-d\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.298639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4edd7f24-219e-4ecf-9376-30176c5d0e79-ovn-node-metrics-cert\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.298677 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-tmp\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.300743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.299477 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-etc-tuned\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.303178 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.303126 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kmkg\" (UniqueName: \"kubernetes.io/projected/2df4d50c-b902-4b5b-b038-7ae915d02ce6-kube-api-access-2kmkg\") pod \"aws-ebs-csi-driver-node-qqgmt\" (UID: \"2df4d50c-b902-4b5b-b038-7ae915d02ce6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.303178 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.303128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6blxc\" (UniqueName: \"kubernetes.io/projected/4edd7f24-219e-4ecf-9376-30176c5d0e79-kube-api-access-6blxc\") pod \"ovnkube-node-z7hqw\" (UID: \"4edd7f24-219e-4ecf-9376-30176c5d0e79\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.303555 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.303528 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lmh\" (UniqueName: \"kubernetes.io/projected/fff23fb8-4ee0-4558-8324-907b4d02a3e8-kube-api-access-h2lmh\") pod \"multus-additional-cni-plugins-mw92f\" (UID: \"fff23fb8-4ee0-4558-8324-907b4d02a3e8\") " pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.304181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.304158 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s7b7\" (UniqueName: \"kubernetes.io/projected/96519635-dda3-4b18-9630-97116a6ec75b-kube-api-access-8s7b7\") pod \"multus-z6zzh\" (UID: \"96519635-dda3-4b18-9630-97116a6ec75b\") " pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.305505 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.305483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26fsl\" (UniqueName: \"kubernetes.io/projected/012c7efd-fdf1-40f7-b8bf-e442e07a46ac-kube-api-access-26fsl\") pod \"tuned-hc5bm\" (UID: \"012c7efd-fdf1-40f7-b8bf-e442e07a46ac\") " pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.397856 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.397819 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef686d13-2ae1-4214-b106-af9b65a6d82d-tmp-dir\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.397866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffd37509-b8ff-4538-af18-a925ba1bb75f-host\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.397888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh4f2\" (UniqueName: \"kubernetes.io/projected/b127fdb1-7fb1-457b-b4f1-2906e66966da-kube-api-access-rh4f2\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.397936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.397957 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffd37509-b8ff-4538-af18-a925ba1bb75f-host\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.397963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffd37509-b8ff-4538-af18-a925ba1bb75f-serviceca\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56808c34-a0b6-4720-b5a3-07cbbc792669-iptables-alerter-script\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd46d5fa-ce73-485b-b729-4be45deaf694-kubelet-config\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.398140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef686d13-2ae1-4214-b106-af9b65a6d82d-hosts-file\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56808c34-a0b6-4720-b5a3-07cbbc792669-host-slash\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.398174 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398247 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd46d5fa-ce73-485b-b729-4be45deaf694-kubelet-config\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef686d13-2ae1-4214-b106-af9b65a6d82d-tmp-dir\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef686d13-2ae1-4214-b106-af9b65a6d82d-hosts-file\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.398315 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:42:25.898277257 +0000 UTC m=+3.064671421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfzd\" (UniqueName: \"kubernetes.io/projected/56808c34-a0b6-4720-b5a3-07cbbc792669-kube-api-access-rkfzd\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56808c34-a0b6-4720-b5a3-07cbbc792669-host-slash\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.398176 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.398384 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret podName:dd46d5fa-ce73-485b-b729-4be45deaf694 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:25.898373221 +0000 UTC m=+3.064767376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret") pod "global-pull-secret-syncer-cb2mv" (UID: "dd46d5fa-ce73-485b-b729-4be45deaf694") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtg9p\" (UniqueName: \"kubernetes.io/projected/ffd37509-b8ff-4538-af18-a925ba1bb75f-kube-api-access-jtg9p\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cff61510-503c-4955-b1e2-9c6a80d24e8e-konnectivity-ca\") pod \"konnectivity-agent-qpswc\" (UID: \"cff61510-503c-4955-b1e2-9c6a80d24e8e\") " pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktbt8\" (UniqueName: \"kubernetes.io/projected/ef686d13-2ae1-4214-b106-af9b65a6d82d-kube-api-access-ktbt8\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398501 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffd37509-b8ff-4538-af18-a925ba1bb75f-serviceca\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cff61510-503c-4955-b1e2-9c6a80d24e8e-agent-certs\") pod \"konnectivity-agent-qpswc\" (UID: \"cff61510-503c-4955-b1e2-9c6a80d24e8e\") " pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.398616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd46d5fa-ce73-485b-b729-4be45deaf694-dbus\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.399313 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398760 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd46d5fa-ce73-485b-b729-4be45deaf694-dbus\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.399313 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56808c34-a0b6-4720-b5a3-07cbbc792669-iptables-alerter-script\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.399313 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.398952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cff61510-503c-4955-b1e2-9c6a80d24e8e-konnectivity-ca\") pod \"konnectivity-agent-qpswc\" (UID: \"cff61510-503c-4955-b1e2-9c6a80d24e8e\") " pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.400955 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.400934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cff61510-503c-4955-b1e2-9c6a80d24e8e-agent-certs\") pod \"konnectivity-agent-qpswc\" (UID: \"cff61510-503c-4955-b1e2-9c6a80d24e8e\") " pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.404381 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.404347 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:25.404381 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.404384 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:25.404539 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.404400 2574 projected.go:196] Error preparing data for projected volume kube-api-access-zbgt6 for pod openshift-network-diagnostics/network-check-target-pc96t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:25.404539 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.404464 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6 podName:515464cc-98c0-4709-9d51-ccaab60b2de8 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:25.90444749 +0000 UTC m=+3.070841650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zbgt6" (UniqueName: "kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6") pod "network-check-target-pc96t" (UID: "515464cc-98c0-4709-9d51-ccaab60b2de8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:25.407181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.407105 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktbt8\" (UniqueName: \"kubernetes.io/projected/ef686d13-2ae1-4214-b106-af9b65a6d82d-kube-api-access-ktbt8\") pod \"node-resolver-bdd45\" (UID: \"ef686d13-2ae1-4214-b106-af9b65a6d82d\") " pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.407313 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.407259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh4f2\" (UniqueName: \"kubernetes.io/projected/b127fdb1-7fb1-457b-b4f1-2906e66966da-kube-api-access-rh4f2\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:25.410071 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.410045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtg9p\" (UniqueName: \"kubernetes.io/projected/ffd37509-b8ff-4538-af18-a925ba1bb75f-kube-api-access-jtg9p\") pod \"node-ca-czvqp\" (UID: \"ffd37509-b8ff-4538-af18-a925ba1bb75f\") " pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.411714 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.411658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfzd\" (UniqueName: \"kubernetes.io/projected/56808c34-a0b6-4720-b5a3-07cbbc792669-kube-api-access-rkfzd\") pod \"iptables-alerter-4jw24\" (UID: \"56808c34-a0b6-4720-b5a3-07cbbc792669\") " pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.484006 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.483969 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" Jun 12 18:42:25.492417 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.492375 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mw92f" Jun 12 18:42:25.500157 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.500131 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" Jun 12 18:42:25.506987 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.506966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6zzh" Jun 12 18:42:25.513695 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.513673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:25.521392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.521367 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:25.527923 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.527892 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bdd45" Jun 12 18:42:25.535635 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.535615 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-czvqp" Jun 12 18:42:25.541349 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.541328 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4jw24" Jun 12 18:42:25.903103 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.903063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:25.903320 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:25.903117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:25.903320 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.903251 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:25.903320 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.903252 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:25.903495 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.903334 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret podName:dd46d5fa-ce73-485b-b729-4be45deaf694 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:26.903316773 +0000 UTC m=+4.069710914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret") pod "global-pull-secret-syncer-cb2mv" (UID: "dd46d5fa-ce73-485b-b729-4be45deaf694") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:25.903495 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:25.903361 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:42:26.903343989 +0000 UTC m=+4.069738130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:26.003471 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.003441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:26.003646 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.003627 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:26.003704 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.003656 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:26.003704 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.003666 2574 projected.go:196] Error preparing data for projected volume kube-api-access-zbgt6 for pod openshift-network-diagnostics/network-check-target-pc96t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:26.003771 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.003723 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6 podName:515464cc-98c0-4709-9d51-ccaab60b2de8 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:27.003706395 +0000 UTC m=+4.170100536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbgt6" (UniqueName: "kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6") pod "network-check-target-pc96t" (UID: "515464cc-98c0-4709-9d51-ccaab60b2de8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:26.004507 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.004480 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd37509_b8ff_4538_af18_a925ba1bb75f.slice/crio-307e22cbf4990c97e71f39d43abbde93e2e985f671e4606ee717b7d3601d1ee6 WatchSource:0}: Error finding container 307e22cbf4990c97e71f39d43abbde93e2e985f671e4606ee717b7d3601d1ee6: Status 404 returned error can't find the container with id 307e22cbf4990c97e71f39d43abbde93e2e985f671e4606ee717b7d3601d1ee6 Jun 12 18:42:26.005587 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.005567 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96519635_dda3_4b18_9630_97116a6ec75b.slice/crio-2abae9ef814e86abe906515836120afdf0e87cd1d09a200b91ec2dca15896d54 WatchSource:0}: Error finding container 2abae9ef814e86abe906515836120afdf0e87cd1d09a200b91ec2dca15896d54: Status 404 returned error can't find the container with id 2abae9ef814e86abe906515836120afdf0e87cd1d09a200b91ec2dca15896d54 Jun 12 18:42:26.006944 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.006886 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56808c34_a0b6_4720_b5a3_07cbbc792669.slice/crio-b7270cb1f61124394beaf076ea151bb2fdfc96cf2e23d5266811646c6ab54734 WatchSource:0}: Error finding container b7270cb1f61124394beaf076ea151bb2fdfc96cf2e23d5266811646c6ab54734: Status 404 returned error can't find the container with id b7270cb1f61124394beaf076ea151bb2fdfc96cf2e23d5266811646c6ab54734 Jun 12 18:42:26.010151 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.010128 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edd7f24_219e_4ecf_9376_30176c5d0e79.slice/crio-a53221d873c85449b97f2eb676d4693b6a06dd30680052d2b4bcfffdf81ad687 WatchSource:0}: Error finding container a53221d873c85449b97f2eb676d4693b6a06dd30680052d2b4bcfffdf81ad687: Status 404 returned error can't find the container with id a53221d873c85449b97f2eb676d4693b6a06dd30680052d2b4bcfffdf81ad687 Jun 12 18:42:26.031601 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.031576 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012c7efd_fdf1_40f7_b8bf_e442e07a46ac.slice/crio-c08a08881732f9f41c542e0c50c66fe30240536b2e027d75c8e17c606f7929cf WatchSource:0}: Error finding container c08a08881732f9f41c542e0c50c66fe30240536b2e027d75c8e17c606f7929cf: Status 404 returned error can't find the container with id c08a08881732f9f41c542e0c50c66fe30240536b2e027d75c8e17c606f7929cf Jun 12 18:42:26.032317 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.032280 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df4d50c_b902_4b5b_b038_7ae915d02ce6.slice/crio-bc3fd5cc74393c4d1bcb1607d1e5dc734340fa6e99f5879eb9e2509334afed38 WatchSource:0}: Error finding container bc3fd5cc74393c4d1bcb1607d1e5dc734340fa6e99f5879eb9e2509334afed38: Status 404 returned error can't find the container with id bc3fd5cc74393c4d1bcb1607d1e5dc734340fa6e99f5879eb9e2509334afed38 Jun 12 18:42:26.033125 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.033048 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff61510_503c_4955_b1e2_9c6a80d24e8e.slice/crio-9dd0ad567c2273d3af86989986ad5c29aed12858e7556ad40c5fcd73543c3997 WatchSource:0}: Error finding container 9dd0ad567c2273d3af86989986ad5c29aed12858e7556ad40c5fcd73543c3997: Status 404 returned error can't find the container with id 9dd0ad567c2273d3af86989986ad5c29aed12858e7556ad40c5fcd73543c3997 Jun 12 18:42:26.034773 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.034171 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef686d13_2ae1_4214_b106_af9b65a6d82d.slice/crio-1677b3444ddcf385906be3082b3ce046ac1784e45e942d318feb084647baeeb1 WatchSource:0}: Error finding container 1677b3444ddcf385906be3082b3ce046ac1784e45e942d318feb084647baeeb1: Status 404 returned error can't find the container with id 1677b3444ddcf385906be3082b3ce046ac1784e45e942d318feb084647baeeb1 Jun 12 18:42:26.034924 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:26.034890 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff23fb8_4ee0_4558_8324_907b4d02a3e8.slice/crio-62e1c71eb50d56cb4928fb27a65bd2d103c9ad8bf6f7a896b97884c57e90f6a0 WatchSource:0}: Error finding container 62e1c71eb50d56cb4928fb27a65bd2d103c9ad8bf6f7a896b97884c57e90f6a0: Status 404 returned error can't find the container with id 62e1c71eb50d56cb4928fb27a65bd2d103c9ad8bf6f7a896b97884c57e90f6a0 Jun 12 18:42:26.223007 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.222886 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:37:25 +0000 UTC" deadline="2027-12-01 08:22:47.510468098 +0000 UTC" Jun 12 18:42:26.223007 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.222950 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12877h40m21.287520767s" Jun 12 18:42:26.259083 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.259036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6zzh" event={"ID":"96519635-dda3-4b18-9630-97116a6ec75b","Type":"ContainerStarted","Data":"2abae9ef814e86abe906515836120afdf0e87cd1d09a200b91ec2dca15896d54"} Jun 12 18:42:26.261143 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.261112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" event={"ID":"f5f57386a7aab263f3254ec2336712d8","Type":"ContainerStarted","Data":"f67e9f918b9ce3866043ac71c88b9fa44941258de4b7af8c87d4207ddecc69c6"} Jun 12 18:42:26.262396 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.262364 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qpswc" event={"ID":"cff61510-503c-4955-b1e2-9c6a80d24e8e","Type":"ContainerStarted","Data":"9dd0ad567c2273d3af86989986ad5c29aed12858e7556ad40c5fcd73543c3997"} Jun 12 18:42:26.263408 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.263388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" event={"ID":"012c7efd-fdf1-40f7-b8bf-e442e07a46ac","Type":"ContainerStarted","Data":"c08a08881732f9f41c542e0c50c66fe30240536b2e027d75c8e17c606f7929cf"} Jun 12 18:42:26.264441 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.264361 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" event={"ID":"2df4d50c-b902-4b5b-b038-7ae915d02ce6","Type":"ContainerStarted","Data":"bc3fd5cc74393c4d1bcb1607d1e5dc734340fa6e99f5879eb9e2509334afed38"} Jun 12 18:42:26.265414 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.265394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"a53221d873c85449b97f2eb676d4693b6a06dd30680052d2b4bcfffdf81ad687"} Jun 12 18:42:26.266562 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.266542 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-czvqp" event={"ID":"ffd37509-b8ff-4538-af18-a925ba1bb75f","Type":"ContainerStarted","Data":"307e22cbf4990c97e71f39d43abbde93e2e985f671e4606ee717b7d3601d1ee6"} Jun 12 18:42:26.267716 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.267683 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerStarted","Data":"62e1c71eb50d56cb4928fb27a65bd2d103c9ad8bf6f7a896b97884c57e90f6a0"} Jun 12 18:42:26.268705 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.268675 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bdd45" event={"ID":"ef686d13-2ae1-4214-b106-af9b65a6d82d","Type":"ContainerStarted","Data":"1677b3444ddcf385906be3082b3ce046ac1784e45e942d318feb084647baeeb1"} Jun 12 18:42:26.269770 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.269751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4jw24" event={"ID":"56808c34-a0b6-4720-b5a3-07cbbc792669","Type":"ContainerStarted","Data":"b7270cb1f61124394beaf076ea151bb2fdfc96cf2e23d5266811646c6ab54734"} Jun 12 18:42:26.276010 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.275959 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-145.ec2.internal" podStartSLOduration=1.275946171 podStartE2EDuration="1.275946171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:26.27590408 +0000 UTC m=+3.442298233" watchObservedRunningTime="2026-06-12 18:42:26.275946171 +0000 UTC m=+3.442340333" Jun 12 18:42:26.912055 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.911270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:26.912055 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:26.911346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:26.912055 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.911489 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:26.912055 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.911551 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret podName:dd46d5fa-ce73-485b-b729-4be45deaf694 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:28.911533476 +0000 UTC m=+6.077927630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret") pod "global-pull-secret-syncer-cb2mv" (UID: "dd46d5fa-ce73-485b-b729-4be45deaf694") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:26.912055 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.911951 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:26.912055 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:26.912008 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:42:28.911986138 +0000 UTC m=+6.078380292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:27.012386 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.012331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:27.012576 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:27.012546 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:27.012576 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:27.012573 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:27.012681 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:27.012587 2574 projected.go:196] Error preparing data for projected volume kube-api-access-zbgt6 for pod openshift-network-diagnostics/network-check-target-pc96t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:27.012681 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:27.012645 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6 podName:515464cc-98c0-4709-9d51-ccaab60b2de8 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:29.012627758 +0000 UTC m=+6.179021901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbgt6" (UniqueName: "kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6") pod "network-check-target-pc96t" (UID: "515464cc-98c0-4709-9d51-ccaab60b2de8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:27.223904 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.223810 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:37:25 +0000 UTC" deadline="2027-12-25 10:21:35.974522223 +0000 UTC" Jun 12 18:42:27.223904 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.223848 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13455h39m8.750678679s" Jun 12 18:42:27.249140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.249111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:27.249350 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:27.249254 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:27.249987 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.249452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:27.250148 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:27.250124 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:27.250232 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.249532 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:27.250232 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:27.250223 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:27.269654 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.269434 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:42:27.290480 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.290431 2574 generic.go:356] "Generic (PLEG): container finished" podID="c72eb59462b1ba0026bd9450808ba0f9" containerID="ddfce9ce694c8ec62eb1c896d9b98b87e8b00cb1834f688a0bb0b084b6bcc975" exitCode=0 Jun 12 18:42:27.290806 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:27.290686 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" event={"ID":"c72eb59462b1ba0026bd9450808ba0f9","Type":"ContainerDied","Data":"ddfce9ce694c8ec62eb1c896d9b98b87e8b00cb1834f688a0bb0b084b6bcc975"} Jun 12 18:42:28.305818 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:28.305775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" event={"ID":"c72eb59462b1ba0026bd9450808ba0f9","Type":"ContainerStarted","Data":"227c8954f07cd58a84b80113a763172571190050e07dfa9625b64cee37a3663e"} Jun 12 18:42:28.928181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:28.928122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:28.928500 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:28.928185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:28.928500 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:28.928376 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:28.928500 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:28.928446 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret podName:dd46d5fa-ce73-485b-b729-4be45deaf694 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:32.928428067 +0000 UTC m=+10.094822228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret") pod "global-pull-secret-syncer-cb2mv" (UID: "dd46d5fa-ce73-485b-b729-4be45deaf694") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:28.928688 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:28.928498 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:28.928688 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:28.928564 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:42:32.928546702 +0000 UTC m=+10.094940863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:29.029301 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:29.029248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:29.029532 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:29.029504 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:29.029532 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:29.029530 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:29.029660 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:29.029543 2574 projected.go:196] Error preparing data for projected volume kube-api-access-zbgt6 for pod openshift-network-diagnostics/network-check-target-pc96t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:29.029660 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:29.029606 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6 podName:515464cc-98c0-4709-9d51-ccaab60b2de8 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:33.029587933 +0000 UTC m=+10.195982089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbgt6" (UniqueName: "kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6") pod "network-check-target-pc96t" (UID: "515464cc-98c0-4709-9d51-ccaab60b2de8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:29.250641 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:29.250062 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:29.250641 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:29.250194 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:29.250641 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:29.250210 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:29.250641 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:29.250335 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:29.250641 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:29.250415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:29.250641 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:29.250505 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:31.249009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:31.248976 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:31.249750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:31.249015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:31.249750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:31.248978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:31.249750 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:31.249096 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:31.249750 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:31.249189 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:31.249750 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:31.249274 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:32.960599 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:32.960557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:32.961142 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:32.960618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:32.961142 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:32.960739 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:32.961142 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:32.960803 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret podName:dd46d5fa-ce73-485b-b729-4be45deaf694 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:40.960782752 +0000 UTC m=+18.127176911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret") pod "global-pull-secret-syncer-cb2mv" (UID: "dd46d5fa-ce73-485b-b729-4be45deaf694") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:32.961346 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:32.961227 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:32.961346 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:32.961309 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:42:40.961275254 +0000 UTC m=+18.127669406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:33.061461 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:33.061412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:33.061772 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:33.061646 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:33.061772 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:33.061667 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:33.061772 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:33.061679 2574 projected.go:196] Error preparing data for projected volume kube-api-access-zbgt6 for pod openshift-network-diagnostics/network-check-target-pc96t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:33.061772 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:33.061736 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6 podName:515464cc-98c0-4709-9d51-ccaab60b2de8 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:41.061718677 +0000 UTC m=+18.228112831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbgt6" (UniqueName: "kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6") pod "network-check-target-pc96t" (UID: "515464cc-98c0-4709-9d51-ccaab60b2de8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:33.250783 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:33.250243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:33.250783 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:33.250264 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:33.250783 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:33.250385 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:33.250783 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:33.250446 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:33.250783 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:33.250515 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:33.250783 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:33.250610 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:35.249824 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:35.249346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:35.249824 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:35.249381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:35.249824 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:35.249348 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:35.249824 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:35.249485 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:35.249824 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:35.249620 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:35.249824 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:35.249692 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:36.326992 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.326953 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-czvqp" event={"ID":"ffd37509-b8ff-4538-af18-a925ba1bb75f","Type":"ContainerStarted","Data":"7ff1a8e1d83ce673003e760c982f8eaca07cd65c839a45dc2d0464540b7acbd0"} Jun 12 18:42:36.331532 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.331129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerStarted","Data":"5097f1f618463770e27d578002445926ee4f039bf993b02e689a034f95d25197"} Jun 12 18:42:36.334762 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.334649 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bdd45" event={"ID":"ef686d13-2ae1-4214-b106-af9b65a6d82d","Type":"ContainerStarted","Data":"c7b8bc7589c567479eba8145de87df886f30ad2cfd5f4ea2f55cbaa45f254730"} Jun 12 18:42:36.337637 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.337149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qpswc" event={"ID":"cff61510-503c-4955-b1e2-9c6a80d24e8e","Type":"ContainerStarted","Data":"2bfa89dcaf57293aabad96593ee7a09f3319caf33fa1c24ecce14b61fb0d4494"} Jun 12 18:42:36.341110 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.339859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" event={"ID":"012c7efd-fdf1-40f7-b8bf-e442e07a46ac","Type":"ContainerStarted","Data":"acfdcb84d2e95edaaac201e649b70fab25a84828ef9b8f61b2d809880db16038"} Jun 12 18:42:36.341110 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.340881 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-145.ec2.internal" podStartSLOduration=11.340864513 podStartE2EDuration="11.340864513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:28.321495466 +0000 UTC m=+5.487889629" watchObservedRunningTime="2026-06-12 18:42:36.340864513 +0000 UTC m=+13.507258682" Jun 12 18:42:36.342509 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.342472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" event={"ID":"2df4d50c-b902-4b5b-b038-7ae915d02ce6","Type":"ContainerStarted","Data":"a19e2ef4db93b01d62ba69301c317c333f2b2263e83a24533d54ff45a2a4d328"} Jun 12 18:42:36.357116 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.357069 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-czvqp" podStartSLOduration=3.274441946 podStartE2EDuration="13.357046412s" totalImagesPullingTime="10.082604466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:36.34080647 +0000 UTC m=+13.507200633" watchObservedRunningTime="2026-06-12 18:42:36.357046412 +0000 UTC m=+13.523440575" Jun 12 18:42:36.357444 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.357419 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hc5bm" podStartSLOduration=3.268974601 podStartE2EDuration="13.357412173s" totalImagesPullingTime="10.088437572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:36.357230996 +0000 UTC m=+13.523625160" watchObservedRunningTime="2026-06-12 18:42:36.357412173 +0000 UTC m=+13.523806334" Jun 12 18:42:36.416187 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.416070 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qpswc" podStartSLOduration=3.409237561 podStartE2EDuration="13.416047496s" totalImagesPullingTime="10.006809935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:36.415418645 +0000 UTC m=+13.581812807" watchObservedRunningTime="2026-06-12 18:42:36.416047496 +0000 UTC m=+13.582441659" Jun 12 18:42:36.416356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.416228 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bdd45" podStartSLOduration=3.358293872 podStartE2EDuration="13.416220536s" totalImagesPullingTime="10.057926664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:36.401308763 +0000 UTC m=+13.567702917" watchObservedRunningTime="2026-06-12 18:42:36.416220536 +0000 UTC m=+13.582614697" Jun 12 18:42:36.726336 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.726298 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:36.727008 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:36.726981 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:37.249394 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:37.249348 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:37.249394 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:37.249390 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:37.249617 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:37.249348 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:37.249617 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:37.249494 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:37.249617 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:37.249572 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:37.249786 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:37.249658 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:38.348445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:38.348411 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:42:38.348445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:38.348419 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4jw24" event={"ID":"56808c34-a0b6-4720-b5a3-07cbbc792669","Type":"ContainerStarted","Data":"4ddc3ee8f8206554cc9f35b8b7c39d8623c53152db9321d6d16a54f64cb9c7a7"} Jun 12 18:42:38.364037 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:38.363978 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4jw24" podStartSLOduration=5.283017534 podStartE2EDuration="15.363956034s" totalImagesPullingTime="10.0809385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:38.363155663 +0000 UTC m=+15.529549825" watchObservedRunningTime="2026-06-12 18:42:38.363956034 +0000 UTC m=+15.530350196" Jun 12 18:42:38.571938 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:38.571896 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:38.572761 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:38.572734 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qpswc" Jun 12 18:42:39.249311 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:39.249210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:39.249311 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:39.249223 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:39.249534 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:39.249363 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:39.249534 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:39.249431 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:39.249534 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:39.249447 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:39.249534 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:39.249531 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:40.354672 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:40.354336 2574 generic.go:356] "Generic (PLEG): container finished" podID="fff23fb8-4ee0-4558-8324-907b4d02a3e8" containerID="5097f1f618463770e27d578002445926ee4f039bf993b02e689a034f95d25197" exitCode=0 Jun 12 18:42:40.355099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:40.354387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerDied","Data":"5097f1f618463770e27d578002445926ee4f039bf993b02e689a034f95d25197"} Jun 12 18:42:41.025597 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:41.025540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:41.025815 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:41.025669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:41.025889 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.025808 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:41.025940 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.025892 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:42:57.025868605 +0000 UTC m=+34.192262748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:41.026004 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.025933 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:41.026004 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.025994 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret podName:dd46d5fa-ce73-485b-b729-4be45deaf694 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:57.025977088 +0000 UTC m=+34.192371249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret") pod "global-pull-secret-syncer-cb2mv" (UID: "dd46d5fa-ce73-485b-b729-4be45deaf694") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:41.126627 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:41.126588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:41.126804 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.126776 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:41.126854 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.126807 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:41.126854 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.126821 2574 projected.go:196] Error preparing data for projected volume kube-api-access-zbgt6 for pod openshift-network-diagnostics/network-check-target-pc96t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:41.126935 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.126887 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6 podName:515464cc-98c0-4709-9d51-ccaab60b2de8 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:57.126869179 +0000 UTC m=+34.293263320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbgt6" (UniqueName: "kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6") pod "network-check-target-pc96t" (UID: "515464cc-98c0-4709-9d51-ccaab60b2de8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:41.249553 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:41.249517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:41.249712 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:41.249529 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:41.249712 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.249655 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:41.249841 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:41.249536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:41.249841 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.249769 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:41.249841 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:41.249829 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:43.249892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:43.249855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:43.250385 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:43.249982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:43.250385 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:43.249985 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:43.250385 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:43.250080 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:43.250385 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:43.250127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:43.250385 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:43.250200 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:45.185619 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.185472 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 18:42:45.249794 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.249767 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:45.249938 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.249812 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:45.249938 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.249767 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:45.249938 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:45.249890 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:45.250084 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:45.249948 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:45.250084 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:45.250016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:45.254790 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.254695 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T18:42:45.185609962Z","UUID":"f681a882-b848-45a2-b3ff-7ea360e2afdb","Handler":null,"Name":"","Endpoint":""} Jun 12 18:42:45.256073 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.256054 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 18:42:45.256166 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.256095 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 18:42:45.366762 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.366736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" event={"ID":"2df4d50c-b902-4b5b-b038-7ae915d02ce6","Type":"ContainerStarted","Data":"7a9d94d143d0576f7e4ef2fb023e7482f3ddf7778b9fdfd6caafbc7017c1adb2"} Jun 12 18:42:45.370060 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.370035 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"423b18e4be94571b8bed93c48b23196b2bd60a98cc07e6478ec43cdda6076a48"} Jun 12 18:42:45.370153 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.370102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"b0ade06c2327b5c015e270e86598b6c1a4f79462738857cafcf36db74905c57b"} Jun 12 18:42:45.370153 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.370133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"fb2a4baad8cbe429dd5f8bf015a09275244ccf412efcdd2a11dea2c56af54d79"} Jun 12 18:42:45.370225 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.370161 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"7d20f5f5ffc0b4411e02ee9c0ed43712a7627d05816fe4fc8403b766fa6ad029"} Jun 12 18:42:45.370225 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.370189 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"dfbc353b66a999be41c4907c2fa57116307d3817b418461b11b9474c23c83bee"} Jun 12 18:42:45.371364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.371337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6zzh" event={"ID":"96519635-dda3-4b18-9630-97116a6ec75b","Type":"ContainerStarted","Data":"48bc9ebddd4214ba1a58e5c2d08e4e0e4efb859b8edfd26d08f9a0c47f077117"} Jun 12 18:42:45.388037 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:45.387986 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z6zzh" podStartSLOduration=3.551596441 podStartE2EDuration="22.387972444s" totalImagesPullingTime="18.836376003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:45.387513068 +0000 UTC m=+22.553907229" watchObservedRunningTime="2026-06-12 18:42:45.387972444 +0000 UTC m=+22.554366605" Jun 12 18:42:46.376377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:46.376340 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" event={"ID":"2df4d50c-b902-4b5b-b038-7ae915d02ce6","Type":"ContainerStarted","Data":"03980af058809f9e70c337ff62027355ede95eadf71936a240d9b71fd52066c8"} Jun 12 18:42:46.380253 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:46.380075 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"f2ba8318ac553aed0cc1eae5bd17cce738df6f9bc34c8ef680587262cd64d967"} Jun 12 18:42:46.396579 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:46.396523 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqgmt" podStartSLOduration=3.76319342 podStartE2EDuration="23.396507015s" totalImagesPullingTime="19.633313595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:46.396030321 +0000 UTC m=+23.562424483" watchObservedRunningTime="2026-06-12 18:42:46.396507015 +0000 UTC m=+23.562901176" Jun 12 18:42:47.249305 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:47.249261 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:47.249485 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:47.249265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:47.249485 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:47.249412 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:47.249575 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:47.249500 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:47.249575 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:47.249273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:47.249679 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:47.249591 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:48.388847 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:48.388811 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"f3bccb9c5bbc05c9fa8747ff5a176e47fce3a5d284f5323f341e4cad95e73378"} Jun 12 18:42:49.249897 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:49.249860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:49.250076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:49.249906 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:49.250076 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:49.250021 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:49.250223 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:49.250090 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:49.250223 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:49.250147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:49.250355 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:49.250238 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:50.397393 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:50.397187 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" event={"ID":"4edd7f24-219e-4ecf-9376-30176c5d0e79","Type":"ContainerStarted","Data":"c240857cedf43afcbe33a8fcbb3abc91a2cd192f4c693dcea397ba4bc797cc80"} Jun 12 18:42:50.397956 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:50.397487 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:50.399249 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:50.399223 2574 generic.go:356] "Generic (PLEG): container finished" podID="fff23fb8-4ee0-4558-8324-907b4d02a3e8" containerID="11aa32673c5d535c965a89aa72e16c4297a89584d45c1a22eaf455d9f3fc2fed" exitCode=0 Jun 12 18:42:50.399452 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:50.399273 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerDied","Data":"11aa32673c5d535c965a89aa72e16c4297a89584d45c1a22eaf455d9f3fc2fed"} Jun 12 18:42:50.413466 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:50.413443 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:50.431195 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:50.431146 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" podStartSLOduration=8.561359131 podStartE2EDuration="27.431131653s" totalImagesPullingTime="18.869772522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:50.430820243 +0000 UTC m=+27.597214424" watchObservedRunningTime="2026-06-12 18:42:50.431131653 +0000 UTC m=+27.597525814" Jun 12 18:42:51.249386 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.249353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:51.249601 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.249353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:51.249601 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.249353 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:51.249601 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:51.249512 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:51.249601 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:51.249567 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:51.249806 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:51.249673 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:51.405003 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.403344 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:42:51.405003 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.404916 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:51.420652 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.420625 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:51.620393 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.620182 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrm78"] Jun 12 18:42:51.620532 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.620506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:51.620620 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:51.620601 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:51.623597 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.623569 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cb2mv"] Jun 12 18:42:51.623760 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.623688 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:51.623835 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:51.623809 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:51.624232 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.624206 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pc96t"] Jun 12 18:42:51.624344 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:51.624320 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:51.624431 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:51.624409 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:52.407344 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:52.407311 2574 generic.go:356] "Generic (PLEG): container finished" podID="fff23fb8-4ee0-4558-8324-907b4d02a3e8" containerID="a0b7b1b0d636ae5193be2d94be74f495e4263307c85c7f08b3ebd0e218eca5e0" exitCode=0 Jun 12 18:42:52.407729 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:52.407383 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerDied","Data":"a0b7b1b0d636ae5193be2d94be74f495e4263307c85c7f08b3ebd0e218eca5e0"} Jun 12 18:42:52.407729 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:52.407476 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:42:53.249958 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:53.249917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:53.250131 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:53.250006 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:53.250131 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:53.250034 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:53.250228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:53.250137 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:53.250228 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:53.250162 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:53.250228 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:53.250203 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:53.252151 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:53.252133 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:42:54.414813 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:54.414780 2574 generic.go:356] "Generic (PLEG): container finished" podID="fff23fb8-4ee0-4558-8324-907b4d02a3e8" containerID="4040822c6875d95dc51f3fb9c2722120196d5138b992c767dc9d1fbf49f20169" exitCode=0 Jun 12 18:42:54.415446 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:54.414860 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerDied","Data":"4040822c6875d95dc51f3fb9c2722120196d5138b992c767dc9d1fbf49f20169"} Jun 12 18:42:54.432208 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:54.432166 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" podUID="4edd7f24-219e-4ecf-9376-30176c5d0e79" containerName="ovnkube-controller" probeResult="failure" output="" Jun 12 18:42:55.249370 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:55.249337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:55.249523 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:55.249374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:55.249523 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:55.249337 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:55.249523 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:55.249464 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:55.249613 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:55.249566 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:55.249675 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:55.249655 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:57.042925 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:57.042884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:57.043603 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:57.042945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:57.043603 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.043039 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:57.043603 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.043081 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:57.043603 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.043124 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:43:29.043102844 +0000 UTC m=+66.209497004 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:42:57.043603 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.043140 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret podName:dd46d5fa-ce73-485b-b729-4be45deaf694 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:29.043133724 +0000 UTC m=+66.209527864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret") pod "global-pull-secret-syncer-cb2mv" (UID: "dd46d5fa-ce73-485b-b729-4be45deaf694") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:42:57.143531 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:57.143497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:57.143687 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.143626 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:42:57.143687 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.143642 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:42:57.143687 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.143651 2574 projected.go:196] Error preparing data for projected volume kube-api-access-zbgt6 for pod openshift-network-diagnostics/network-check-target-pc96t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:57.143789 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.143705 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6 podName:515464cc-98c0-4709-9d51-ccaab60b2de8 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:29.14368758 +0000 UTC m=+66.310081735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbgt6" (UniqueName: "kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6") pod "network-check-target-pc96t" (UID: "515464cc-98c0-4709-9d51-ccaab60b2de8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:42:57.249212 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:57.249184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:57.249394 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:57.249183 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:57.249394 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.249312 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pc96t" podUID="515464cc-98c0-4709-9d51-ccaab60b2de8" Jun 12 18:42:57.249394 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:57.249184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:57.249553 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.249400 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cb2mv" podUID="dd46d5fa-ce73-485b-b729-4be45deaf694" Jun 12 18:42:57.249553 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:57.249469 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:42:58.646754 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.646723 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-145.ec2.internal" event="NodeReady" Jun 12 18:42:58.647209 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.646913 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 18:42:58.701801 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.701233 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tsklz"] Jun 12 18:42:58.714496 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.714468 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nlrz5"] Jun 12 18:42:58.714648 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.714605 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.718040 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.717892 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 18:42:58.718040 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.717894 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkhgt\"" Jun 12 18:42:58.718236 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.717954 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 18:42:58.730908 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.730885 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tsklz"] Jun 12 18:42:58.731022 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.730926 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlrz5"] Jun 12 18:42:58.731022 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.730990 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:58.733637 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.733611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jmkqw\"" Jun 12 18:42:58.733637 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.733638 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 18:42:58.733825 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.733660 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 18:42:58.733825 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.733715 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 18:42:58.856540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.856497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/659110db-f8d3-454b-a50d-66a0b0ab4047-config-volume\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.856540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.856541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.856777 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.856593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659110db-f8d3-454b-a50d-66a0b0ab4047-tmp-dir\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.856777 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.856637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2-cert\") pod \"ingress-canary-nlrz5\" (UID: \"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2\") " pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:58.856777 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.856716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2c8p\" (UniqueName: \"kubernetes.io/projected/659110db-f8d3-454b-a50d-66a0b0ab4047-kube-api-access-k2c8p\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.856905 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.856783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-852r2\" (UniqueName: \"kubernetes.io/projected/0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2-kube-api-access-852r2\") pod \"ingress-canary-nlrz5\" (UID: \"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2\") " pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:58.957879 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.957793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2-cert\") pod \"ingress-canary-nlrz5\" (UID: \"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2\") " pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:58.957879 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.957840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8p\" (UniqueName: \"kubernetes.io/projected/659110db-f8d3-454b-a50d-66a0b0ab4047-kube-api-access-k2c8p\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.958099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.957935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-852r2\" (UniqueName: \"kubernetes.io/projected/0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2-kube-api-access-852r2\") pod \"ingress-canary-nlrz5\" (UID: \"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2\") " pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:58.958099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.957963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/659110db-f8d3-454b-a50d-66a0b0ab4047-config-volume\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.958099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.957978 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.958099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.958005 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659110db-f8d3-454b-a50d-66a0b0ab4047-tmp-dir\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.958377 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:58.958135 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:42:58.958377 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:58.958205 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:59.458182829 +0000 UTC m=+36.624576972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:42:58.958377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.958269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/659110db-f8d3-454b-a50d-66a0b0ab4047-tmp-dir\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.958594 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.958556 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/659110db-f8d3-454b-a50d-66a0b0ab4047-config-volume\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.962128 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.962111 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2-cert\") pod \"ingress-canary-nlrz5\" (UID: \"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2\") " pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:58.969161 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.969140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2c8p\" (UniqueName: \"kubernetes.io/projected/659110db-f8d3-454b-a50d-66a0b0ab4047-kube-api-access-k2c8p\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:58.969396 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:58.969375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-852r2\" (UniqueName: \"kubernetes.io/projected/0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2-kube-api-access-852r2\") pod \"ingress-canary-nlrz5\" (UID: \"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2\") " pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:59.039399 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.039354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nlrz5" Jun 12 18:42:59.249525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.249496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:42:59.249679 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.249497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:42:59.249679 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.249655 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:42:59.252759 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.252724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:42:59.252759 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.252753 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-knsbj\"" Jun 12 18:42:59.253144 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.252998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:42:59.253144 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.253092 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:42:59.253478 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.253459 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:42:59.253970 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.253950 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g7n4k\"" Jun 12 18:42:59.273578 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.273483 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nlrz5"] Jun 12 18:42:59.278866 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:42:59.278840 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0623f7c3_6e0b_4e8f_9f75_9a7fff0b5ba2.slice/crio-97f9984a89d5df70bea9425fdc38ceecf2214aa5e854f895a575b3b30db6aa91 WatchSource:0}: Error finding container 97f9984a89d5df70bea9425fdc38ceecf2214aa5e854f895a575b3b30db6aa91: Status 404 returned error can't find the container with id 97f9984a89d5df70bea9425fdc38ceecf2214aa5e854f895a575b3b30db6aa91 Jun 12 18:42:59.428942 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.428906 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlrz5" event={"ID":"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2","Type":"ContainerStarted","Data":"97f9984a89d5df70bea9425fdc38ceecf2214aa5e854f895a575b3b30db6aa91"} Jun 12 18:42:59.431492 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.431463 2574 generic.go:356] "Generic (PLEG): container finished" podID="fff23fb8-4ee0-4558-8324-907b4d02a3e8" containerID="3e79c60d985674002aa1b2902fa0c2feb3e66901c5000cb0a88bda69757c3d0d" exitCode=0 Jun 12 18:42:59.431635 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.431510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerDied","Data":"3e79c60d985674002aa1b2902fa0c2feb3e66901c5000cb0a88bda69757c3d0d"} Jun 12 18:42:59.461982 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:42:59.461952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:42:59.462105 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:59.462078 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:42:59.462160 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:42:59.462129 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:00.462115013 +0000 UTC m=+37.628509167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:43:00.437352 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:00.437157 2574 generic.go:356] "Generic (PLEG): container finished" podID="fff23fb8-4ee0-4558-8324-907b4d02a3e8" containerID="c023edc6739714a1209e57944db5430d5e9537220dc30ff2e08e5e0546d6e95f" exitCode=0 Jun 12 18:43:00.437740 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:00.437223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerDied","Data":"c023edc6739714a1209e57944db5430d5e9537220dc30ff2e08e5e0546d6e95f"} Jun 12 18:43:00.470965 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:00.470935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:43:00.471133 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:00.471115 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:00.471204 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:00.471179 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:02.471162373 +0000 UTC m=+39.637556533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:43:01.442893 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:01.442863 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw92f" event={"ID":"fff23fb8-4ee0-4558-8324-907b4d02a3e8","Type":"ContainerStarted","Data":"d411d9e2083b8e60bdbd99998e489195d656b3654fd91b1dfa25f886b507a1b1"} Jun 12 18:43:02.446102 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:02.446065 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nlrz5" event={"ID":"0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2","Type":"ContainerStarted","Data":"61f2788a7774815bb282c0320754dd18da41630877704c666db337e191bdaa4f"} Jun 12 18:43:02.461326 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:02.461251 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mw92f" podStartSLOduration=13.252524339 podStartE2EDuration="39.461229754s" totalImagesPullingTime="26.208705415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:01.484234179 +0000 UTC m=+38.650628363" watchObservedRunningTime="2026-06-12 18:43:02.461229754 +0000 UTC m=+39.627623914" Jun 12 18:43:02.488379 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:02.488346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:43:02.488642 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:02.488516 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:02.488642 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:02.488597 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:06.48857679 +0000 UTC m=+43.654970938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:43:06.519185 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:06.519140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:43:06.519710 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:06.519341 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:06.519710 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:06.519443 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:14.519425969 +0000 UTC m=+51.685820112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:43:14.572804 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:14.572759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:43:14.573376 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:14.572917 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:14.573376 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:14.572986 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:43:30.57296761 +0000 UTC m=+67.739361755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:43:24.425581 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:24.425540 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7hqw" Jun 12 18:43:24.462533 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:24.462474 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nlrz5" podStartSLOduration=24.364958949 podStartE2EDuration="26.462458309s" totalImagesPullingTime="2.09749936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:02.461040321 +0000 UTC m=+39.627434495" watchObservedRunningTime="2026-06-12 18:43:24.462458309 +0000 UTC m=+61.628852474" Jun 12 18:43:26.642844 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.642809 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk"] Jun 12 18:43:26.647002 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.646979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.654550 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.654528 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 18:43:26.658314 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.658278 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 18:43:26.658481 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.658465 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8zdhn\"" Jun 12 18:43:26.658564 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.658546 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 18:43:26.658788 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.658773 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 18:43:26.662435 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.662412 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm"] Jun 12 18:43:26.664023 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.664009 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.666881 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.666864 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 12 18:43:26.672079 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.672057 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk"] Jun 12 18:43:26.676902 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.676884 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm"] Jun 12 18:43:26.759923 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.759879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e12a4486-6cf9-4e58-a2af-9dd41720740b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk\" (UID: \"e12a4486-6cf9-4e58-a2af-9dd41720740b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.760094 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.760010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcrrc\" (UniqueName: \"kubernetes.io/projected/e12a4486-6cf9-4e58-a2af-9dd41720740b-kube-api-access-kcrrc\") pod \"managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk\" (UID: \"e12a4486-6cf9-4e58-a2af-9dd41720740b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.861198 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.861156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcrrc\" (UniqueName: \"kubernetes.io/projected/e12a4486-6cf9-4e58-a2af-9dd41720740b-kube-api-access-kcrrc\") pod \"managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk\" (UID: \"e12a4486-6cf9-4e58-a2af-9dd41720740b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.861416 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.861205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b734325f-2cff-419e-b32c-4d8abad924d6-tmp\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.861416 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.861235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b734325f-2cff-419e-b32c-4d8abad924d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.861416 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.861257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blrcl\" (UniqueName: \"kubernetes.io/projected/b734325f-2cff-419e-b32c-4d8abad924d6-kube-api-access-blrcl\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.861416 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.861322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e12a4486-6cf9-4e58-a2af-9dd41720740b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk\" (UID: \"e12a4486-6cf9-4e58-a2af-9dd41720740b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.864895 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.864868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e12a4486-6cf9-4e58-a2af-9dd41720740b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk\" (UID: \"e12a4486-6cf9-4e58-a2af-9dd41720740b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.870155 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.870132 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcrrc\" (UniqueName: \"kubernetes.io/projected/e12a4486-6cf9-4e58-a2af-9dd41720740b-kube-api-access-kcrrc\") pod \"managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk\" (UID: \"e12a4486-6cf9-4e58-a2af-9dd41720740b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.962462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.962374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b734325f-2cff-419e-b32c-4d8abad924d6-tmp\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.962462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.962413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b734325f-2cff-419e-b32c-4d8abad924d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.962462 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.962431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blrcl\" (UniqueName: \"kubernetes.io/projected/b734325f-2cff-419e-b32c-4d8abad924d6-kube-api-access-blrcl\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.962884 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.962859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b734325f-2cff-419e-b32c-4d8abad924d6-tmp\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.964897 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.964864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b734325f-2cff-419e-b32c-4d8abad924d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.965627 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.965608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" Jun 12 18:43:26.971815 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.971787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blrcl\" (UniqueName: \"kubernetes.io/projected/b734325f-2cff-419e-b32c-4d8abad924d6-kube-api-access-blrcl\") pod \"klusterlet-addon-workmgr-6dd45cf658-8lwzm\" (UID: \"b734325f-2cff-419e-b32c-4d8abad924d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:26.973458 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:26.973438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:27.117179 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:27.117147 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk"] Jun 12 18:43:27.121585 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:43:27.121556 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode12a4486_6cf9_4e58_a2af_9dd41720740b.slice/crio-d018ed4600edfa015fec388e79b0bb606cbef828f8fd9b83356b39a0b026b438 WatchSource:0}: Error finding container d018ed4600edfa015fec388e79b0bb606cbef828f8fd9b83356b39a0b026b438: Status 404 returned error can't find the container with id d018ed4600edfa015fec388e79b0bb606cbef828f8fd9b83356b39a0b026b438 Jun 12 18:43:27.131067 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:27.131039 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm"] Jun 12 18:43:27.134104 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:43:27.134079 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb734325f_2cff_419e_b32c_4d8abad924d6.slice/crio-8f6bf982d2315a2ebce09270d5f91500e22274a3073ceddb328bc04f94496967 WatchSource:0}: Error finding container 8f6bf982d2315a2ebce09270d5f91500e22274a3073ceddb328bc04f94496967: Status 404 returned error can't find the container with id 8f6bf982d2315a2ebce09270d5f91500e22274a3073ceddb328bc04f94496967 Jun 12 18:43:27.508117 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:27.508077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" event={"ID":"b734325f-2cff-419e-b32c-4d8abad924d6","Type":"ContainerStarted","Data":"8f6bf982d2315a2ebce09270d5f91500e22274a3073ceddb328bc04f94496967"} Jun 12 18:43:27.509032 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:27.509009 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" event={"ID":"e12a4486-6cf9-4e58-a2af-9dd41720740b","Type":"ContainerStarted","Data":"d018ed4600edfa015fec388e79b0bb606cbef828f8fd9b83356b39a0b026b438"} Jun 12 18:43:29.084757 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.084709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:43:29.085218 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.084785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:43:29.088217 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.087988 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:43:29.088217 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.088023 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:43:29.095434 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:29.095274 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:43:29.095434 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:29.095387 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:44:33.095363092 +0000 UTC m=+130.261757255 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : secret "metrics-daemon-secret" not found Jun 12 18:43:29.097939 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.097910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd46d5fa-ce73-485b-b729-4be45deaf694-original-pull-secret\") pod \"global-pull-secret-syncer-cb2mv\" (UID: \"dd46d5fa-ce73-485b-b729-4be45deaf694\") " pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:43:29.185671 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.185630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:43:29.188788 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.188753 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:43:29.198739 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.198706 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:43:29.210348 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.210270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgt6\" (UniqueName: \"kubernetes.io/projected/515464cc-98c0-4709-9d51-ccaab60b2de8-kube-api-access-zbgt6\") pod \"network-check-target-pc96t\" (UID: \"515464cc-98c0-4709-9d51-ccaab60b2de8\") " pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:43:29.261189 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.261160 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cb2mv" Jun 12 18:43:29.269843 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.269812 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-knsbj\"" Jun 12 18:43:29.277302 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:29.277254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:43:30.596304 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:30.596152 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:43:30.596919 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:30.596352 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:43:30.596919 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:43:30.596436 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:44:02.596414759 +0000 UTC m=+99.762808922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:43:31.698860 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:31.698617 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pc96t"] Jun 12 18:43:31.701668 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:43:31.701553 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515464cc_98c0_4709_9d51_ccaab60b2de8.slice/crio-520c6d8527d445f1b695f826355ea16918579ba08535c50ef17dc23e1b9dca50 WatchSource:0}: Error finding container 520c6d8527d445f1b695f826355ea16918579ba08535c50ef17dc23e1b9dca50: Status 404 returned error can't find the container with id 520c6d8527d445f1b695f826355ea16918579ba08535c50ef17dc23e1b9dca50 Jun 12 18:43:31.711818 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:31.711750 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cb2mv"] Jun 12 18:43:31.716036 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:43:31.716005 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd46d5fa_ce73_485b_b729_4be45deaf694.slice/crio-ddfa53eee02c9171372957d1b6fe915487303e66293cb744c927c48a2499e7d5 WatchSource:0}: Error finding container ddfa53eee02c9171372957d1b6fe915487303e66293cb744c927c48a2499e7d5: Status 404 returned error can't find the container with id ddfa53eee02c9171372957d1b6fe915487303e66293cb744c927c48a2499e7d5 Jun 12 18:43:32.525773 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.525664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" event={"ID":"e12a4486-6cf9-4e58-a2af-9dd41720740b","Type":"ContainerStarted","Data":"1968aec795a66ef165607fd4de225d51834127abbab463fc3fe6b0f805b1a6c4"} Jun 12 18:43:32.527326 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.527272 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pc96t" event={"ID":"515464cc-98c0-4709-9d51-ccaab60b2de8","Type":"ContainerStarted","Data":"520c6d8527d445f1b695f826355ea16918579ba08535c50ef17dc23e1b9dca50"} Jun 12 18:43:32.528748 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.528712 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cb2mv" event={"ID":"dd46d5fa-ce73-485b-b729-4be45deaf694","Type":"ContainerStarted","Data":"ddfa53eee02c9171372957d1b6fe915487303e66293cb744c927c48a2499e7d5"} Jun 12 18:43:32.530452 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.530427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" event={"ID":"b734325f-2cff-419e-b32c-4d8abad924d6","Type":"ContainerStarted","Data":"067f0351c4286e63212b22aa6a0faf653c1c2c2877f024f780f0023b24520ce7"} Jun 12 18:43:32.530630 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.530613 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:32.532895 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.532722 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:43:32.540975 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.540928 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" podStartSLOduration=2.082542892 podStartE2EDuration="6.540911069s" totalImagesPullingTime="4.458368177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:32.540870197 +0000 UTC m=+69.707264376" watchObservedRunningTime="2026-06-12 18:43:32.540911069 +0000 UTC m=+69.707305231" Jun 12 18:43:32.559528 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:32.559465 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" podStartSLOduration=2.096905927 podStartE2EDuration="6.559440794s" totalImagesPullingTime="4.462534867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:32.557634418 +0000 UTC m=+69.724028580" watchObservedRunningTime="2026-06-12 18:43:32.559440794 +0000 UTC m=+69.725834957" Jun 12 18:43:36.543677 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:36.543635 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pc96t" event={"ID":"515464cc-98c0-4709-9d51-ccaab60b2de8","Type":"ContainerStarted","Data":"8d34b58cf0a215be5ab4771bfdda500282bb2334c1ca7e5090440b900331ea54"} Jun 12 18:43:36.544062 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:36.543809 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:43:36.545184 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:36.545159 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cb2mv" event={"ID":"dd46d5fa-ce73-485b-b729-4be45deaf694","Type":"ContainerStarted","Data":"456ecff1d8c49e6b70f85310aa497a98de6f22aec347c4a35f331908022b9f8a"} Jun 12 18:43:36.561755 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:36.561705 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pc96t" podStartSLOduration=68.833257021 podStartE2EDuration="1m13.561689357s" totalImagesPullingTime="4.728432336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:36.5611975 +0000 UTC m=+73.727591695" watchObservedRunningTime="2026-06-12 18:43:36.561689357 +0000 UTC m=+73.728083512" Jun 12 18:43:36.577152 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:43:36.577080 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cb2mv" podStartSLOduration=68.863213383 podStartE2EDuration="1m13.577059092s" totalImagesPullingTime="4.713845709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:36.575899842 +0000 UTC m=+73.742294005" watchObservedRunningTime="2026-06-12 18:43:36.577059092 +0000 UTC m=+73.743453255" Jun 12 18:44:02.618014 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:44:02.617971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:44:02.618592 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:44:02.618124 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:44:02.618592 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:44:02.618189 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:45:06.618173167 +0000 UTC m=+163.784567307 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:44:07.550903 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:44:07.550873 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pc96t" Jun 12 18:44:33.122879 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:44:33.122834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:44:33.123367 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:44:33.122981 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:44:33.123367 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:44:33.123051 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs podName:b127fdb1-7fb1-457b-b4f1-2906e66966da nodeName:}" failed. No retries permitted until 2026-06-12 18:46:35.12303477 +0000 UTC m=+252.289428910 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs") pod "network-metrics-daemon-zrm78" (UID: "b127fdb1-7fb1-457b-b4f1-2906e66966da") : secret "metrics-daemon-secret" not found Jun 12 18:45:01.724436 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:45:01.724396 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tsklz" podUID="659110db-f8d3-454b-a50d-66a0b0ab4047" Jun 12 18:45:01.754732 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:01.754702 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsklz" Jun 12 18:45:02.271105 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:45:02.271061 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zrm78" podUID="b127fdb1-7fb1-457b-b4f1-2906e66966da" Jun 12 18:45:06.652540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:06.652496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:45:06.653004 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:45:06.652650 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:45:06.653004 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:45:06.652712 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls podName:659110db-f8d3-454b-a50d-66a0b0ab4047 nodeName:}" failed. No retries permitted until 2026-06-12 18:47:08.652698794 +0000 UTC m=+285.819092938 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls") pod "dns-default-tsklz" (UID: "659110db-f8d3-454b-a50d-66a0b0ab4047") : secret "dns-default-metrics-tls" not found Jun 12 18:45:16.249440 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:16.249397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:45:31.828995 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:31.828964 2574 generic.go:356] "Generic (PLEG): container finished" podID="b734325f-2cff-419e-b32c-4d8abad924d6" containerID="067f0351c4286e63212b22aa6a0faf653c1c2c2877f024f780f0023b24520ce7" exitCode=1 Jun 12 18:45:31.829376 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:31.829044 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" event={"ID":"b734325f-2cff-419e-b32c-4d8abad924d6","Type":"ContainerDied","Data":"067f0351c4286e63212b22aa6a0faf653c1c2c2877f024f780f0023b24520ce7"} Jun 12 18:45:31.829469 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:31.829454 2574 scope.go:117] "RemoveContainer" containerID="067f0351c4286e63212b22aa6a0faf653c1c2c2877f024f780f0023b24520ce7" Jun 12 18:45:31.830573 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:31.830541 2574 generic.go:356] "Generic (PLEG): container finished" podID="e12a4486-6cf9-4e58-a2af-9dd41720740b" containerID="1968aec795a66ef165607fd4de225d51834127abbab463fc3fe6b0f805b1a6c4" exitCode=255 Jun 12 18:45:31.830684 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:31.830576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" event={"ID":"e12a4486-6cf9-4e58-a2af-9dd41720740b","Type":"ContainerDied","Data":"1968aec795a66ef165607fd4de225d51834127abbab463fc3fe6b0f805b1a6c4"} Jun 12 18:45:31.893787 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:31.893766 2574 scope.go:117] "RemoveContainer" containerID="1968aec795a66ef165607fd4de225d51834127abbab463fc3fe6b0f805b1a6c4" Jun 12 18:45:32.531584 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:32.531530 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:45:32.835786 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:32.835690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d9c7f8f48-5vqsk" event={"ID":"e12a4486-6cf9-4e58-a2af-9dd41720740b","Type":"ContainerStarted","Data":"6a7ec9dfb1806c904b0c8ca2827f43e682c6699d1f586847c0a1ac19e1d41458"} Jun 12 18:45:32.837336 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:32.837307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" event={"ID":"b734325f-2cff-419e-b32c-4d8abad924d6","Type":"ContainerStarted","Data":"7028263c6a475a28a502fb181b2a723d2662e978f1071b291819aca602c9410f"} Jun 12 18:45:32.837524 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:32.837506 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:45:32.838114 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:45:32.838095 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6dd45cf658-8lwzm" Jun 12 18:46:05.708255 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.708212 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5ddfbbb75d-lxkps"] Jun 12 18:46:05.711196 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.711180 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.714722 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.714696 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 18:46:05.714833 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.714787 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 18:46:05.714895 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.714787 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 18:46:05.715379 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.715361 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gqf86\"" Jun 12 18:46:05.736145 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.736124 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 18:46:05.746689 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.746656 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddfbbb75d-lxkps"] Jun 12 18:46:05.766589 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-trusted-ca\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.766764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-registry-certificates\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.766764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-bound-sa-token\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.766764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5gjc\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-kube-api-access-k5gjc\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.766764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-image-registry-private-configuration\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.766764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-installation-pull-secrets\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.766936 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/214aced2-0b42-4f85-80a4-81071c853b2b-ca-trust-extracted\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.766936 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.766825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.799266 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.799239 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2"] Jun 12 18:46:05.801981 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.801955 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.807317 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.807268 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:46:05.807448 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.807344 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 12 18:46:05.807448 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.807353 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-f2672\"" Jun 12 18:46:05.807448 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.807397 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 12 18:46:05.810583 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.810564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 12 18:46:05.814869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.814849 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2"] Jun 12 18:46:05.867407 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7w2b\" (UniqueName: \"kubernetes.io/projected/0588f18a-7918-4c8a-bf48-30e74ce62e00-kube-api-access-p7w2b\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.867407 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-image-registry-private-configuration\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-installation-pull-secrets\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0588f18a-7918-4c8a-bf48-30e74ce62e00-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/214aced2-0b42-4f85-80a4-81071c853b2b-ca-trust-extracted\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-trusted-ca\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0588f18a-7918-4c8a-bf48-30e74ce62e00-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-registry-certificates\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:05.867627 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:05.867641 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddfbbb75d-lxkps: secret "image-registry-tls" not found Jun 12 18:46:05.867657 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-bound-sa-token\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.868113 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.867674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5gjc\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-kube-api-access-k5gjc\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.868113 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:05.867696 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls podName:214aced2-0b42-4f85-80a4-81071c853b2b nodeName:}" failed. No retries permitted until 2026-06-12 18:46:06.367677329 +0000 UTC m=+223.534071484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls") pod "image-registry-5ddfbbb75d-lxkps" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b") : secret "image-registry-tls" not found Jun 12 18:46:05.868275 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.868246 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-registry-certificates\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.868441 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.868422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/214aced2-0b42-4f85-80a4-81071c853b2b-ca-trust-extracted\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.868512 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.868494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-trusted-ca\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.869825 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.869802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-installation-pull-secrets\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.869974 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.869956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-image-registry-private-configuration\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.880073 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.880047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-bound-sa-token\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.881495 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.881475 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5gjc\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-kube-api-access-k5gjc\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:05.968824 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.968718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0588f18a-7918-4c8a-bf48-30e74ce62e00-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.968824 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.968770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7w2b\" (UniqueName: \"kubernetes.io/projected/0588f18a-7918-4c8a-bf48-30e74ce62e00-kube-api-access-p7w2b\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.968824 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.968792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0588f18a-7918-4c8a-bf48-30e74ce62e00-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.969365 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.969345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0588f18a-7918-4c8a-bf48-30e74ce62e00-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.971062 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.971042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0588f18a-7918-4c8a-bf48-30e74ce62e00-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:05.978898 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:05.978876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7w2b\" (UniqueName: \"kubernetes.io/projected/0588f18a-7918-4c8a-bf48-30e74ce62e00-kube-api-access-p7w2b\") pod \"kube-storage-version-migrator-operator-7c578b78fc-b9sm2\" (UID: \"0588f18a-7918-4c8a-bf48-30e74ce62e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:06.110324 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:06.110266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" Jun 12 18:46:06.232990 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:06.232908 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2"] Jun 12 18:46:06.236843 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:06.236819 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0588f18a_7918_4c8a_bf48_30e74ce62e00.slice/crio-b12be8fb707475e01f85cac0fbe7e65ed74dadb71c86b6db7f1576e252db2aaf WatchSource:0}: Error finding container b12be8fb707475e01f85cac0fbe7e65ed74dadb71c86b6db7f1576e252db2aaf: Status 404 returned error can't find the container with id b12be8fb707475e01f85cac0fbe7e65ed74dadb71c86b6db7f1576e252db2aaf Jun 12 18:46:06.372704 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:06.372660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:06.372885 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:06.372808 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:46:06.372885 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:06.372830 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddfbbb75d-lxkps: secret "image-registry-tls" not found Jun 12 18:46:06.372885 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:06.372884 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls podName:214aced2-0b42-4f85-80a4-81071c853b2b nodeName:}" failed. No retries permitted until 2026-06-12 18:46:07.372867473 +0000 UTC m=+224.539261637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls") pod "image-registry-5ddfbbb75d-lxkps" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b") : secret "image-registry-tls" not found Jun 12 18:46:06.935067 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:06.935026 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" event={"ID":"0588f18a-7918-4c8a-bf48-30e74ce62e00","Type":"ContainerStarted","Data":"b12be8fb707475e01f85cac0fbe7e65ed74dadb71c86b6db7f1576e252db2aaf"} Jun 12 18:46:07.380213 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:07.380178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:07.380397 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:07.380372 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:46:07.380397 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:07.380390 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddfbbb75d-lxkps: secret "image-registry-tls" not found Jun 12 18:46:07.380472 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:07.380442 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls podName:214aced2-0b42-4f85-80a4-81071c853b2b nodeName:}" failed. No retries permitted until 2026-06-12 18:46:09.380426206 +0000 UTC m=+226.546820346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls") pod "image-registry-5ddfbbb75d-lxkps" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b") : secret "image-registry-tls" not found Jun 12 18:46:08.942587 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:08.942543 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" event={"ID":"0588f18a-7918-4c8a-bf48-30e74ce62e00","Type":"ContainerStarted","Data":"371240fc962047f313cb7ef653bcbae0388285efba48dc20a35f1639a92e06f9"} Jun 12 18:46:08.958537 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:08.958486 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" podStartSLOduration=1.753510435 podStartE2EDuration="3.95846989s" totalImagesPullingTime="2.204959455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:08.957505486 +0000 UTC m=+226.123899649" watchObservedRunningTime="2026-06-12 18:46:08.95846989 +0000 UTC m=+226.124864052" Jun 12 18:46:09.394675 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.394642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:09.394865 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.394798 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:46:09.394865 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.394817 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddfbbb75d-lxkps: secret "image-registry-tls" not found Jun 12 18:46:09.394865 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.394867 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls podName:214aced2-0b42-4f85-80a4-81071c853b2b nodeName:}" failed. No retries permitted until 2026-06-12 18:46:13.394853207 +0000 UTC m=+230.561247346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls") pod "image-registry-5ddfbbb75d-lxkps" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b") : secret "image-registry-tls" not found Jun 12 18:46:09.753296 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.753204 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2s6cr"] Jun 12 18:46:09.756272 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.756256 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.759926 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.759896 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 12 18:46:09.759926 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.759896 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-btpxq\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-btpxq\"" type="*v1.Secret" Jun 12 18:46:09.760140 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.760120 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 12 18:46:09.760714 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.760685 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-2s6cr\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" podUID="c8f41bbf-4e71-47b3-8138-4e0d18cd40ba" pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.760792 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.760707 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 12 18:46:09.760792 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:09.760718 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-129-145.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-129-145.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 12 18:46:09.790525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.790486 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2s6cr"] Jun 12 18:46:09.898334 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.898265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.898531 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.898355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.898531 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.898407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-crio-socket\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.898531 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.898476 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-data-volume\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.898639 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.898530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrjzg\" (UniqueName: \"kubernetes.io/projected/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-api-access-lrjzg\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.999061 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.999021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-crio-socket\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.999061 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.999066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-data-volume\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.999598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.999086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrjzg\" (UniqueName: \"kubernetes.io/projected/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-api-access-lrjzg\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.999598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.999149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-crio-socket\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.999598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.999156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.999598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.999223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:09.999598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:09.999419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-data-volume\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:10.837974 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:10.837939 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 18:46:10.999636 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:10.999595 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: failed to sync secret cache: timed out waiting for the condition Jun 12 18:46:11.000003 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:10.999693 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:11.499675814 +0000 UTC m=+228.666069954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : failed to sync secret cache: timed out waiting for the condition Jun 12 18:46:11.000003 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:10.999599 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Jun 12 18:46:11.000003 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:10.999765 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:11.499752724 +0000 UTC m=+228.666146864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : failed to sync configmap cache: timed out waiting for the condition Jun 12 18:46:11.006493 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:11.006471 2574 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 12 18:46:11.006559 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:11.006507 2574 projected.go:196] Error preparing data for projected volume kube-api-access-lrjzg for pod openshift-insights/insights-runtime-extractor-2s6cr: failed to sync configmap cache: timed out waiting for the condition Jun 12 18:46:11.006593 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:11.006563 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-api-access-lrjzg podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:11.506544391 +0000 UTC m=+228.672938531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lrjzg" (UniqueName: "kubernetes.io/projected/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-api-access-lrjzg") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : failed to sync configmap cache: timed out waiting for the condition Jun 12 18:46:11.037600 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.037571 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 18:46:11.128639 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.128615 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-btpxq\"" Jun 12 18:46:11.166299 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.166260 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 18:46:11.208087 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.208061 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 18:46:11.512037 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.511949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrjzg\" (UniqueName: \"kubernetes.io/projected/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-api-access-lrjzg\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:11.512037 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.512022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:11.512235 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.512052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:11.512235 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:11.512123 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:11.512235 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:11.512160 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:11.512235 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:11.512179 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:12.512163427 +0000 UTC m=+229.678557567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : configmap "kube-rbac-proxy" not found Jun 12 18:46:11.512235 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:11.512210 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:12.512198623 +0000 UTC m=+229.678592764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:11.514304 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:11.514269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrjzg\" (UniqueName: \"kubernetes.io/projected/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-api-access-lrjzg\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:12.518986 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:12.518946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:12.518986 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:12.518991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:12.519449 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:12.519064 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:12.519449 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:12.519092 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:12.519449 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:12.519114 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:14.519100507 +0000 UTC m=+231.685494647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : configmap "kube-rbac-proxy" not found Jun 12 18:46:12.519449 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:12.519152 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:14.519139918 +0000 UTC m=+231.685534059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:12.769372 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:12.769281 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bdd45_ef686d13-2ae1-4214-b106-af9b65a6d82d/dns-node-resolver/0.log" Jun 12 18:46:13.427408 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:13.427353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:13.427638 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:13.427532 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:46:13.427638 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:13.427558 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5ddfbbb75d-lxkps: secret "image-registry-tls" not found Jun 12 18:46:13.427638 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:13.427623 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls podName:214aced2-0b42-4f85-80a4-81071c853b2b nodeName:}" failed. No retries permitted until 2026-06-12 18:46:21.427603811 +0000 UTC m=+238.593997975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls") pod "image-registry-5ddfbbb75d-lxkps" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b") : secret "image-registry-tls" not found Jun 12 18:46:13.574364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:13.574335 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-czvqp_ffd37509-b8ff-4538-af18-a925ba1bb75f/node-ca/0.log" Jun 12 18:46:14.536732 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:14.536697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:14.536732 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:14.536743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:14.537007 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:14.536840 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:14.537007 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:14.536849 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:14.537007 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:14.536906 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:18.536892588 +0000 UTC m=+235.703286728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : configmap "kube-rbac-proxy" not found Jun 12 18:46:14.537007 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:14.536940 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:18.53691783 +0000 UTC m=+235.703311988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:14.569253 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:14.569222 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlrz5_0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2/serve-healthcheck-canary/0.log" Jun 12 18:46:15.170080 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:15.170046 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-b9sm2_0588f18a-7918-4c8a-bf48-30e74ce62e00/kube-storage-version-migrator-operator/0.log" Jun 12 18:46:18.568177 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:18.568135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:18.568177 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:18.568182 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:18.568624 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:18.568269 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:46:18.568624 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:18.568325 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:46:18.568624 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:18.568364 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:26.568350441 +0000 UTC m=+243.734744585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : configmap "kube-rbac-proxy" not found Jun 12 18:46:18.568624 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:18.568385 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls podName:c8f41bbf-4e71-47b3-8138-4e0d18cd40ba nodeName:}" failed. No retries permitted until 2026-06-12 18:46:26.568370772 +0000 UTC m=+243.734764911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2s6cr" (UID: "c8f41bbf-4e71-47b3-8138-4e0d18cd40ba") : secret "insights-runtime-extractor-tls" not found Jun 12 18:46:21.491661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:21.491622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:21.494034 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:21.494013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"image-registry-5ddfbbb75d-lxkps\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:21.619556 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:21.619503 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:21.754325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:21.754223 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddfbbb75d-lxkps"] Jun 12 18:46:21.757508 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:21.757480 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214aced2_0b42_4f85_80a4_81071c853b2b.slice/crio-63f0fea3ad967d4ea7d5091837a429cbc1adababec7bd70dfbadeed8d2cc8f1a WatchSource:0}: Error finding container 63f0fea3ad967d4ea7d5091837a429cbc1adababec7bd70dfbadeed8d2cc8f1a: Status 404 returned error can't find the container with id 63f0fea3ad967d4ea7d5091837a429cbc1adababec7bd70dfbadeed8d2cc8f1a Jun 12 18:46:21.982952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:21.982913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" event={"ID":"214aced2-0b42-4f85-80a4-81071c853b2b","Type":"ContainerStarted","Data":"3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f"} Jun 12 18:46:21.983132 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:21.982971 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" event={"ID":"214aced2-0b42-4f85-80a4-81071c853b2b","Type":"ContainerStarted","Data":"63f0fea3ad967d4ea7d5091837a429cbc1adababec7bd70dfbadeed8d2cc8f1a"} Jun 12 18:46:21.983132 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:21.983009 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:22.004572 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:22.004458 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" podStartSLOduration=17.004411061 podStartE2EDuration="17.004411061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:22.003757023 +0000 UTC m=+239.170151186" watchObservedRunningTime="2026-06-12 18:46:22.004411061 +0000 UTC m=+239.170805222" Jun 12 18:46:26.629549 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:26.629500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:26.629549 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:26.629548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:26.630044 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:26.630026 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:26.631945 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:26.631911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8f41bbf-4e71-47b3-8138-4e0d18cd40ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2s6cr\" (UID: \"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba\") " pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:26.867143 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:26.867109 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-btpxq\"" Jun 12 18:46:26.874525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:26.874504 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2s6cr" Jun 12 18:46:27.005683 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:27.005652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2s6cr"] Jun 12 18:46:27.008571 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:27.008543 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f41bbf_4e71_47b3_8138_4e0d18cd40ba.slice/crio-f2ed75548e3f76907f31c827f5de4dccc6e7dfe22cdbade8ece6e6b5d246df4a WatchSource:0}: Error finding container f2ed75548e3f76907f31c827f5de4dccc6e7dfe22cdbade8ece6e6b5d246df4a: Status 404 returned error can't find the container with id f2ed75548e3f76907f31c827f5de4dccc6e7dfe22cdbade8ece6e6b5d246df4a Jun 12 18:46:28.002726 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:28.002687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2s6cr" event={"ID":"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba","Type":"ContainerStarted","Data":"f2ed75548e3f76907f31c827f5de4dccc6e7dfe22cdbade8ece6e6b5d246df4a"} Jun 12 18:46:31.014297 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:31.014249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2s6cr" event={"ID":"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba","Type":"ContainerStarted","Data":"aa65c72648374acbf460f98da80bd1e9adc28f779740ee73f5ac0b2aa5d3f2bd"} Jun 12 18:46:31.014686 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:31.014324 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2s6cr" event={"ID":"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba","Type":"ContainerStarted","Data":"bfb035baa1b49a96bfdcec3cd4b224968511f7d72dc0988890e3921bc3eb82cf"} Jun 12 18:46:32.735934 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.735903 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g"] Jun 12 18:46:32.738847 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.738799 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" Jun 12 18:46:32.742477 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.742460 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zx4kw\"" Jun 12 18:46:32.743565 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.743548 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 18:46:32.752019 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.751992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g"] Jun 12 18:46:32.783750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.783712 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5ddfbbb75d-lxkps"] Jun 12 18:46:32.844608 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.844579 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-569f6597b-r6jjd"] Jun 12 18:46:32.847547 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.847531 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.859577 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.859546 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-569f6597b-r6jjd"] Jun 12 18:46:32.879783 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.879741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6602361d-50a9-450c-8ab7-4f75410c1829-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rxh2g\" (UID: \"6602361d-50a9-450c-8ab7-4f75410c1829\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" Jun 12 18:46:32.980238 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/577378d3-e3ab-450e-9958-481dbf218b7e-registry-certificates\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.980437 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/577378d3-e3ab-450e-9958-481dbf218b7e-ca-trust-extracted\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.980437 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/577378d3-e3ab-450e-9958-481dbf218b7e-installation-pull-secrets\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.980437 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980353 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/577378d3-e3ab-450e-9958-481dbf218b7e-image-registry-private-configuration\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.980437 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/577378d3-e3ab-450e-9958-481dbf218b7e-trusted-ca\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.980437 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz97v\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-kube-api-access-xz97v\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.980597 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-bound-sa-token\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.980597 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6602361d-50a9-450c-8ab7-4f75410c1829-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rxh2g\" (UID: \"6602361d-50a9-450c-8ab7-4f75410c1829\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" Jun 12 18:46:32.980597 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.980509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-registry-tls\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:32.983046 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:32.983013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6602361d-50a9-450c-8ab7-4f75410c1829-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-rxh2g\" (UID: \"6602361d-50a9-450c-8ab7-4f75410c1829\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" Jun 12 18:46:33.022663 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.022564 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2s6cr" event={"ID":"c8f41bbf-4e71-47b3-8138-4e0d18cd40ba","Type":"ContainerStarted","Data":"a8e372adeb1a9f12a989e3f9140d738d7a242ab7f9ad4c79aa89efae6b7d34a9"} Jun 12 18:46:33.044590 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.044539 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2s6cr" podStartSLOduration=18.689276014 podStartE2EDuration="24.044521584s" totalImagesPullingTime="5.35524557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:46:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:33.043739616 +0000 UTC m=+250.210133814" watchObservedRunningTime="2026-06-12 18:46:33.044521584 +0000 UTC m=+250.210915745" Jun 12 18:46:33.046700 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.046683 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" Jun 12 18:46:33.081605 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.081569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/577378d3-e3ab-450e-9958-481dbf218b7e-registry-certificates\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.081794 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.081639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/577378d3-e3ab-450e-9958-481dbf218b7e-ca-trust-extracted\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.081794 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.081668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/577378d3-e3ab-450e-9958-481dbf218b7e-installation-pull-secrets\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.081794 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.081700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/577378d3-e3ab-450e-9958-481dbf218b7e-image-registry-private-configuration\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.081794 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.081726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/577378d3-e3ab-450e-9958-481dbf218b7e-trusted-ca\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.082043 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.081996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz97v\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-kube-api-access-xz97v\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.082095 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.082045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-bound-sa-token\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.082141 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.082100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-registry-tls\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.082655 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.082620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/577378d3-e3ab-450e-9958-481dbf218b7e-registry-certificates\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.082777 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.082689 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/577378d3-e3ab-450e-9958-481dbf218b7e-ca-trust-extracted\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.083173 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.083148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/577378d3-e3ab-450e-9958-481dbf218b7e-trusted-ca\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.084310 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.084258 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/577378d3-e3ab-450e-9958-481dbf218b7e-installation-pull-secrets\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.084537 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.084518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/577378d3-e3ab-450e-9958-481dbf218b7e-image-registry-private-configuration\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.085076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.085055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-registry-tls\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.090912 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.090883 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-bound-sa-token\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.091464 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.091435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz97v\" (UniqueName: \"kubernetes.io/projected/577378d3-e3ab-450e-9958-481dbf218b7e-kube-api-access-xz97v\") pod \"image-registry-569f6597b-r6jjd\" (UID: \"577378d3-e3ab-450e-9958-481dbf218b7e\") " pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.156342 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.156304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:33.177407 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.177376 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g"] Jun 12 18:46:33.180626 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:33.180601 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6602361d_50a9_450c_8ab7_4f75410c1829.slice/crio-ad26cd1ad0f7bf9ff925d2a4cebf09d4900e3959ff9e090b062c3281d88ad9bb WatchSource:0}: Error finding container ad26cd1ad0f7bf9ff925d2a4cebf09d4900e3959ff9e090b062c3281d88ad9bb: Status 404 returned error can't find the container with id ad26cd1ad0f7bf9ff925d2a4cebf09d4900e3959ff9e090b062c3281d88ad9bb Jun 12 18:46:33.287992 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:33.287911 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-569f6597b-r6jjd"] Jun 12 18:46:33.291134 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:33.291105 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577378d3_e3ab_450e_9958_481dbf218b7e.slice/crio-fe2b39630ff102630327f1f6e83b991215b4f005d22c8ec202f955735590bf83 WatchSource:0}: Error finding container fe2b39630ff102630327f1f6e83b991215b4f005d22c8ec202f955735590bf83: Status 404 returned error can't find the container with id fe2b39630ff102630327f1f6e83b991215b4f005d22c8ec202f955735590bf83 Jun 12 18:46:34.027935 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:34.027896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" event={"ID":"6602361d-50a9-450c-8ab7-4f75410c1829","Type":"ContainerStarted","Data":"ad26cd1ad0f7bf9ff925d2a4cebf09d4900e3959ff9e090b062c3281d88ad9bb"} Jun 12 18:46:34.029522 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:34.029489 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" event={"ID":"577378d3-e3ab-450e-9958-481dbf218b7e","Type":"ContainerStarted","Data":"0a3a95060b339858e09addd6eecbc967d6ed1c22f4d2c5450153a0eaece57e7c"} Jun 12 18:46:34.029672 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:34.029547 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:46:34.029672 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:34.029567 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" event={"ID":"577378d3-e3ab-450e-9958-481dbf218b7e","Type":"ContainerStarted","Data":"fe2b39630ff102630327f1f6e83b991215b4f005d22c8ec202f955735590bf83"} Jun 12 18:46:34.048832 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:34.048785 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podStartSLOduration=2.048770145 podStartE2EDuration="2.048770145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:34.047760268 +0000 UTC m=+251.214154429" watchObservedRunningTime="2026-06-12 18:46:34.048770145 +0000 UTC m=+251.215164316" Jun 12 18:46:35.034598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.034541 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" event={"ID":"6602361d-50a9-450c-8ab7-4f75410c1829","Type":"ContainerStarted","Data":"a41a4c301a3dba7819e3e44904edce4db57c827d6f4d13625b74f78b47672cc7"} Jun 12 18:46:35.035033 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.034913 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" Jun 12 18:46:35.039459 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.039429 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" Jun 12 18:46:35.051104 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.051053 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-rxh2g" podStartSLOduration=1.903516598 podStartE2EDuration="3.051039375s" totalImagesPullingTime="1.147522777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:35.04901635 +0000 UTC m=+252.215410523" watchObservedRunningTime="2026-06-12 18:46:35.051039375 +0000 UTC m=+252.217433574" Jun 12 18:46:35.199023 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.198979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:46:35.201377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.201350 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b127fdb1-7fb1-457b-b4f1-2906e66966da-metrics-certs\") pod \"network-metrics-daemon-zrm78\" (UID: \"b127fdb1-7fb1-457b-b4f1-2906e66966da\") " pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:46:35.453085 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.453050 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g7n4k\"" Jun 12 18:46:35.461262 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.461236 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrm78" Jun 12 18:46:35.585667 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:35.585632 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrm78"] Jun 12 18:46:35.590118 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:35.590084 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb127fdb1_7fb1_457b_b4f1_2906e66966da.slice/crio-565ce8ea2432c642add44aa92b42766cedd71137e83b603989ebb82cc38653fe WatchSource:0}: Error finding container 565ce8ea2432c642add44aa92b42766cedd71137e83b603989ebb82cc38653fe: Status 404 returned error can't find the container with id 565ce8ea2432c642add44aa92b42766cedd71137e83b603989ebb82cc38653fe Jun 12 18:46:36.039935 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:36.039897 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrm78" event={"ID":"b127fdb1-7fb1-457b-b4f1-2906e66966da","Type":"ContainerStarted","Data":"565ce8ea2432c642add44aa92b42766cedd71137e83b603989ebb82cc38653fe"} Jun 12 18:46:37.045327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:37.045268 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrm78" event={"ID":"b127fdb1-7fb1-457b-b4f1-2906e66966da","Type":"ContainerStarted","Data":"95f5d3f9e1d1f7fbf1844c1a1896b481b806b7ccce51bb5e3c66c45d5ae1dde4"} Jun 12 18:46:37.045707 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:37.045343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrm78" event={"ID":"b127fdb1-7fb1-457b-b4f1-2906e66966da","Type":"ContainerStarted","Data":"ba737396dfcc538076d0218e554877e23fa563bb20b16d719aeae645552c4939"} Jun 12 18:46:37.062696 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:37.062644 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zrm78" podStartSLOduration=253.081127104 podStartE2EDuration="4m14.06262561s" totalImagesPullingTime="981.498506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:37.062073836 +0000 UTC m=+254.228467994" watchObservedRunningTime="2026-06-12 18:46:37.06262561 +0000 UTC m=+254.229019772" Jun 12 18:46:40.159304 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.159247 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z"] Jun 12 18:46:40.163774 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.163753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.166337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.166308 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 18:46:40.166478 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.166352 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 18:46:40.167482 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.167461 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 18:46:40.167598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.167500 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 18:46:40.167598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.167540 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 18:46:40.167598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.167576 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-68hn4\"" Jun 12 18:46:40.173980 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.173956 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z"] Jun 12 18:46:40.177751 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.177733 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5x86r"] Jun 12 18:46:40.180950 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.180935 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.183597 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.183567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 18:46:40.183729 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.183710 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89dlx\"" Jun 12 18:46:40.183783 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.183766 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 18:46:40.183834 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.183769 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 18:46:40.241955 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.241921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.241955 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.241960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.242161 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.241979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-textfile\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242161 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057d930b-506e-4429-9c96-0f6bee836424-metrics-client-ca\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242161 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242086 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b97b\" (UniqueName: \"kubernetes.io/projected/057d930b-506e-4429-9c96-0f6bee836424-kube-api-access-8b97b\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242161 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.242161 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-root\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwfpz\" (UniqueName: \"kubernetes.io/projected/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-kube-api-access-wwfpz\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.242377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242194 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-wtmp\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242221 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-sys\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.242377 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.242273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343065 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-root\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343065 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwfpz\" (UniqueName: \"kubernetes.io/projected/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-kube-api-access-wwfpz\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343090 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-wtmp\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-sys\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-root\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343154 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:40.343256 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-textfile\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057d930b-506e-4429-9c96-0f6bee836424-metrics-client-ca\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-wtmp\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343892 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:40.343357 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls podName:057d930b-506e-4429-9c96-0f6bee836424 nodeName:}" failed. No retries permitted until 2026-06-12 18:46:40.843334941 +0000 UTC m=+258.009729091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls") pod "node-exporter-5x86r" (UID: "057d930b-506e-4429-9c96-0f6bee836424") : secret "node-exporter-tls" not found Jun 12 18:46:40.343892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b97b\" (UniqueName: \"kubernetes.io/projected/057d930b-506e-4429-9c96-0f6bee836424-kube-api-access-8b97b\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.343892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057d930b-506e-4429-9c96-0f6bee836424-sys\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.343892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-textfile\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.344147 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343987 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/057d930b-506e-4429-9c96-0f6bee836424-metrics-client-ca\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.344147 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.343999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.344253 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.344168 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.345682 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.345660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.345924 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.345904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.346011 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.345995 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.351269 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.351241 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b97b\" (UniqueName: \"kubernetes.io/projected/057d930b-506e-4429-9c96-0f6bee836424-kube-api-access-8b97b\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.351395 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.351358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwfpz\" (UniqueName: \"kubernetes.io/projected/59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9-kube-api-access-wwfpz\") pod \"openshift-state-metrics-6b8d965dd5-72d8z\" (UID: \"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.472925 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.472827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" Jun 12 18:46:40.606027 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.605855 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z"] Jun 12 18:46:40.608504 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:40.608475 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ab00b2_ed88_4aa6_8ceb_b1b75d50e3e9.slice/crio-be233b8febe0af8d711055ea00626ee47b627baa4a375aadceed057d7d26074b WatchSource:0}: Error finding container be233b8febe0af8d711055ea00626ee47b627baa4a375aadceed057d7d26074b: Status 404 returned error can't find the container with id be233b8febe0af8d711055ea00626ee47b627baa4a375aadceed057d7d26074b Jun 12 18:46:40.848306 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:40.848245 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:40.848450 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:40.848395 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 18:46:40.848510 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:40.848460 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls podName:057d930b-506e-4429-9c96-0f6bee836424 nodeName:}" failed. No retries permitted until 2026-06-12 18:46:41.848444583 +0000 UTC m=+259.014838723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls") pod "node-exporter-5x86r" (UID: "057d930b-506e-4429-9c96-0f6bee836424") : secret "node-exporter-tls" not found Jun 12 18:46:41.060553 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.060464 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" event={"ID":"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9","Type":"ContainerStarted","Data":"56bc22376a02978978b461758e66190740408ec82a3b6628c0336b431219cec1"} Jun 12 18:46:41.060553 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.060521 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" event={"ID":"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9","Type":"ContainerStarted","Data":"5783a3f5798f83b42113e45cf31b58b7322bf30a0f1d43a1b1f2b0371899122e"} Jun 12 18:46:41.060553 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.060541 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" event={"ID":"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9","Type":"ContainerStarted","Data":"be233b8febe0af8d711055ea00626ee47b627baa4a375aadceed057d7d26074b"} Jun 12 18:46:41.235454 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.235412 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:46:41.239840 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.239803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.242759 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.242728 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 18:46:41.243118 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.243074 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r7gr5\"" Jun 12 18:46:41.243499 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.243479 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 18:46:41.243909 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.243573 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 18:46:41.243909 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.243608 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 18:46:41.244076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.243942 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 18:46:41.244076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.243988 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 18:46:41.244202 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.244183 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 18:46:41.244433 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.244220 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 18:46:41.244634 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.244501 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 18:46:41.250453 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250536 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250536 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-web-config\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250536 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250500 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-out\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250679 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250679 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250759 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250825 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx465\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-kube-api-access-wx465\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250876 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250876 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.250876 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.251012 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.251012 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.250979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.254562 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.254525 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:46:41.351392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx465\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-kube-api-access-wx465\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:41.351496 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351534 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:41.351551 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls podName:5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a nodeName:}" failed. No retries permitted until 2026-06-12 18:46:41.851533898 +0000 UTC m=+259.017928042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a") : secret "alertmanager-main-tls" not found Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-web-config\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-out\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.351725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.352133 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.351735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.352393 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.352309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.355496 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.354472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.355496 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.354617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-out\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.355496 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.354680 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.355496 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.355011 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.355496 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:41.355331 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle podName:5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a nodeName:}" failed. No retries permitted until 2026-06-12 18:46:41.855311194 +0000 UTC m=+259.021705359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a") : configmap references non-existent config key: ca-bundle.crt Jun 12 18:46:41.355831 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.355580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.355831 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.355651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.355932 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.355859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.359525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.358243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.360146 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.360125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-web-config\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.362062 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.362042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx465\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-kube-api-access-wx465\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.857854 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.857808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.858051 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.857927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.858051 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.857962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:41.858910 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.858882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.860633 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.860602 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:41.860869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.860848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/057d930b-506e-4429-9c96-0f6bee836424-node-exporter-tls\") pod \"node-exporter-5x86r\" (UID: \"057d930b-506e-4429-9c96-0f6bee836424\") " pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:41.989678 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:41.989640 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x86r" Jun 12 18:46:42.010859 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:42.010816 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057d930b_506e_4429_9c96_0f6bee836424.slice/crio-e268dfaa8f429d4ab76e3f8ee856ac360be96c4895a7b26bceea39b0ec3c44c3 WatchSource:0}: Error finding container e268dfaa8f429d4ab76e3f8ee856ac360be96c4895a7b26bceea39b0ec3c44c3: Status 404 returned error can't find the container with id e268dfaa8f429d4ab76e3f8ee856ac360be96c4895a7b26bceea39b0ec3c44c3 Jun 12 18:46:42.065174 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:42.065143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x86r" event={"ID":"057d930b-506e-4429-9c96-0f6bee836424","Type":"ContainerStarted","Data":"e268dfaa8f429d4ab76e3f8ee856ac360be96c4895a7b26bceea39b0ec3c44c3"} Jun 12 18:46:42.151819 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:42.151727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:46:42.296248 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:42.296223 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:46:42.298482 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:42.298453 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd6ed1f_16a1_44b1_8108_5ec4ad4ab05a.slice/crio-537fc7592c7708a7295081b75aac82d679eacbb5433c84e84b2995d941465323 WatchSource:0}: Error finding container 537fc7592c7708a7295081b75aac82d679eacbb5433c84e84b2995d941465323: Status 404 returned error can't find the container with id 537fc7592c7708a7295081b75aac82d679eacbb5433c84e84b2995d941465323 Jun 12 18:46:42.791074 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:42.791043 2574 patch_prober.go:28] interesting pod/image-registry-5ddfbbb75d-lxkps container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:46:42.791189 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:42.791098 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" podUID="214aced2-0b42-4f85-80a4-81071c853b2b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:46:43.071184 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:43.071091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerStarted","Data":"537fc7592c7708a7295081b75aac82d679eacbb5433c84e84b2995d941465323"} Jun 12 18:46:43.073697 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:43.073664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" event={"ID":"59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9","Type":"ContainerStarted","Data":"c132a086d6aac0428ba4077fca768f86fad7c686ec3f029230df05fa85de7113"} Jun 12 18:46:43.075525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:43.075499 2574 generic.go:356] "Generic (PLEG): container finished" podID="057d930b-506e-4429-9c96-0f6bee836424" containerID="7b488b11aec1da7284fc66b9faf48392db4a8efd42766f0b8852c32313066b04" exitCode=0 Jun 12 18:46:43.075627 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:43.075555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x86r" event={"ID":"057d930b-506e-4429-9c96-0f6bee836424","Type":"ContainerDied","Data":"7b488b11aec1da7284fc66b9faf48392db4a8efd42766f0b8852c32313066b04"} Jun 12 18:46:43.092352 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:43.092296 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-72d8z" podStartSLOduration=1.812074422 podStartE2EDuration="3.092260451s" totalImagesPullingTime="1.280186029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:43.091140685 +0000 UTC m=+260.257534850" watchObservedRunningTime="2026-06-12 18:46:43.092260451 +0000 UTC m=+260.258654616" Jun 12 18:46:44.081103 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.081064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x86r" event={"ID":"057d930b-506e-4429-9c96-0f6bee836424","Type":"ContainerStarted","Data":"6c51efa37a6f6fd4b521285a4752a495689f60cbcc9ac8706604f4e2ec3ef724"} Jun 12 18:46:44.081585 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.081132 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x86r" event={"ID":"057d930b-506e-4429-9c96-0f6bee836424","Type":"ContainerStarted","Data":"ea94d61db1c4b5ac6008b0f87fe44ea88228aee9f65bc3f1478fb122816159d8"} Jun 12 18:46:44.082758 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.082735 2574 generic.go:356] "Generic (PLEG): container finished" podID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerID="20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad" exitCode=0 Jun 12 18:46:44.082859 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.082800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad"} Jun 12 18:46:44.101315 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.101251 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5x86r" podStartSLOduration=3.271800738 podStartE2EDuration="4.101234154s" totalImagesPullingTime="765.93969ms" totalInitContainerRuntime="63.493726ms" isStatefulPod=true podCreationTimestamp="2026-06-12 18:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:44.099168273 +0000 UTC m=+261.265562437" watchObservedRunningTime="2026-06-12 18:46:44.101234154 +0000 UTC m=+261.267628315" Jun 12 18:46:44.946473 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.946421 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r"] Jun 12 18:46:44.949746 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.949720 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:44.952324 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.952274 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 18:46:44.952447 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.952330 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k6qnh\"" Jun 12 18:46:44.959045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.959014 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r"] Jun 12 18:46:44.985492 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.985454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpz5v\" (UniqueName: \"kubernetes.io/projected/b511fa76-2d99-40eb-a1c2-9656e8946d4a-kube-api-access-bpz5v\") pod \"monitoring-plugin-589576dfc7-2xp7r\" (UID: \"b511fa76-2d99-40eb-a1c2-9656e8946d4a\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:44.985664 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:44.985543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b511fa76-2d99-40eb-a1c2-9656e8946d4a-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-2xp7r\" (UID: \"b511fa76-2d99-40eb-a1c2-9656e8946d4a\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:45.086478 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:45.086448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpz5v\" (UniqueName: \"kubernetes.io/projected/b511fa76-2d99-40eb-a1c2-9656e8946d4a-kube-api-access-bpz5v\") pod \"monitoring-plugin-589576dfc7-2xp7r\" (UID: \"b511fa76-2d99-40eb-a1c2-9656e8946d4a\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:45.086876 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:45.086515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b511fa76-2d99-40eb-a1c2-9656e8946d4a-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-2xp7r\" (UID: \"b511fa76-2d99-40eb-a1c2-9656e8946d4a\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:45.086876 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:45.086650 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 12 18:46:45.086876 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:45.086702 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b511fa76-2d99-40eb-a1c2-9656e8946d4a-monitoring-plugin-cert podName:b511fa76-2d99-40eb-a1c2-9656e8946d4a nodeName:}" failed. No retries permitted until 2026-06-12 18:46:45.58668838 +0000 UTC m=+262.753082524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b511fa76-2d99-40eb-a1c2-9656e8946d4a-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-2xp7r" (UID: "b511fa76-2d99-40eb-a1c2-9656e8946d4a") : secret "monitoring-plugin-cert" not found Jun 12 18:46:45.097202 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:45.097167 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpz5v\" (UniqueName: \"kubernetes.io/projected/b511fa76-2d99-40eb-a1c2-9656e8946d4a-kube-api-access-bpz5v\") pod \"monitoring-plugin-589576dfc7-2xp7r\" (UID: \"b511fa76-2d99-40eb-a1c2-9656e8946d4a\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:45.590661 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:45.590569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b511fa76-2d99-40eb-a1c2-9656e8946d4a-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-2xp7r\" (UID: \"b511fa76-2d99-40eb-a1c2-9656e8946d4a\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:45.593169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:45.593144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b511fa76-2d99-40eb-a1c2-9656e8946d4a-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-2xp7r\" (UID: \"b511fa76-2d99-40eb-a1c2-9656e8946d4a\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:45.861970 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:45.861947 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:45.997906 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:45.997879 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r"] Jun 12 18:46:46.001189 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:46.001015 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb511fa76_2d99_40eb_a1c2_9656e8946d4a.slice/crio-a16b721198373b92efd17c39ad06c7e0334de52ccc3abc87285cced4b4257e49 WatchSource:0}: Error finding container a16b721198373b92efd17c39ad06c7e0334de52ccc3abc87285cced4b4257e49: Status 404 returned error can't find the container with id a16b721198373b92efd17c39ad06c7e0334de52ccc3abc87285cced4b4257e49 Jun 12 18:46:46.090834 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.090803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" event={"ID":"b511fa76-2d99-40eb-a1c2-9656e8946d4a","Type":"ContainerStarted","Data":"a16b721198373b92efd17c39ad06c7e0334de52ccc3abc87285cced4b4257e49"} Jun 12 18:46:46.093447 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.093423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerStarted","Data":"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b"} Jun 12 18:46:46.093543 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.093479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerStarted","Data":"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e"} Jun 12 18:46:46.093543 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.093506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerStarted","Data":"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97"} Jun 12 18:46:46.093543 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.093532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerStarted","Data":"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac"} Jun 12 18:46:46.890026 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.889989 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-579d4c657c-pj26n"] Jun 12 18:46:46.893778 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.893752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:46.896817 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.896623 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 18:46:46.896817 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.896709 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 18:46:46.898030 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.897841 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 18:46:46.898030 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.897886 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 18:46:46.898030 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.897983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 18:46:46.898667 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.898504 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 18:46:46.898667 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.898553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 18:46:46.898667 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.898623 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jjx52\"" Jun 12 18:46:46.904839 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.904557 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 18:46:46.905895 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:46.905871 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579d4c657c-pj26n"] Jun 12 18:46:47.001191 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.001151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49r7s\" (UniqueName: \"kubernetes.io/projected/d3d1d977-356f-48f2-95a4-8e7b878f13e6-kube-api-access-49r7s\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.001191 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.001189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-trusted-ca-bundle\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.001445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.001209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-config\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.001445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.001233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-service-ca\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.001445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.001318 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-serving-cert\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.001445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.001362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-oauth-config\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.001445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.001419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-oauth-serving-cert\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.101859 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.101826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-serving-cert\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.102325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.101867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-oauth-config\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.102325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.101910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-oauth-serving-cert\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.102325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.101951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49r7s\" (UniqueName: \"kubernetes.io/projected/d3d1d977-356f-48f2-95a4-8e7b878f13e6-kube-api-access-49r7s\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.102325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.101974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-trusted-ca-bundle\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.102325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.102001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-config\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.102325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.102034 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-service-ca\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.103095 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.103064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-oauth-serving-cert\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.103198 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.103183 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-trusted-ca-bundle\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.103266 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.103203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-config\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.103406 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.103382 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-service-ca\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.104735 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.104714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-serving-cert\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.104844 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.104791 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-oauth-config\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.105392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.105367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerStarted","Data":"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c"} Jun 12 18:46:47.105496 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.105479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerStarted","Data":"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed"} Jun 12 18:46:47.112722 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.112693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49r7s\" (UniqueName: \"kubernetes.io/projected/d3d1d977-356f-48f2-95a4-8e7b878f13e6-kube-api-access-49r7s\") pod \"console-579d4c657c-pj26n\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.136514 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.136462 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.275111497 podStartE2EDuration="6.136446803s" totalImagesPullingTime="3.843475404s" totalInitContainerRuntime="17.859902ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:47.134517783 +0000 UTC m=+264.300911946" watchObservedRunningTime="2026-06-12 18:46:47.136446803 +0000 UTC m=+264.302840962" Jun 12 18:46:47.208204 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.208112 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:47.341602 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:47.341572 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579d4c657c-pj26n"] Jun 12 18:46:47.344476 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:46:47.344444 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d1d977_356f_48f2_95a4_8e7b878f13e6.slice/crio-d8ca2f7ba660b627e7be3b683e34f92e3458e1074519d261612c377e57e4bec7 WatchSource:0}: Error finding container d8ca2f7ba660b627e7be3b683e34f92e3458e1074519d261612c377e57e4bec7: Status 404 returned error can't find the container with id d8ca2f7ba660b627e7be3b683e34f92e3458e1074519d261612c377e57e4bec7 Jun 12 18:46:48.112764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:48.112613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d4c657c-pj26n" event={"ID":"d3d1d977-356f-48f2-95a4-8e7b878f13e6","Type":"ContainerStarted","Data":"d8ca2f7ba660b627e7be3b683e34f92e3458e1074519d261612c377e57e4bec7"} Jun 12 18:46:49.118892 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:49.118858 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" event={"ID":"b511fa76-2d99-40eb-a1c2-9656e8946d4a","Type":"ContainerStarted","Data":"0772756d01e98d544b1672a1b0d4b152afcd620f7ba556792711383a2a04e3a1"} Jun 12 18:46:49.119383 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:49.119060 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:49.124408 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:49.124383 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" Jun 12 18:46:49.137835 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:49.137761 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-2xp7r" podStartSLOduration=3.01474431 podStartE2EDuration="5.13773933s" totalImagesPullingTime="2.12299502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:49.136391116 +0000 UTC m=+266.302785278" watchObservedRunningTime="2026-06-12 18:46:49.13773933 +0000 UTC m=+266.304133493" Jun 12 18:46:51.128526 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:51.128494 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d4c657c-pj26n" event={"ID":"d3d1d977-356f-48f2-95a4-8e7b878f13e6","Type":"ContainerStarted","Data":"4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede"} Jun 12 18:46:51.148488 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:51.148438 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-579d4c657c-pj26n" podStartSLOduration=1.932918344 podStartE2EDuration="5.148423269s" totalImagesPullingTime="3.215504925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:51.146358163 +0000 UTC m=+268.312752334" watchObservedRunningTime="2026-06-12 18:46:51.148423269 +0000 UTC m=+268.314817431" Jun 12 18:46:52.789382 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:52.789344 2574 patch_prober.go:28] interesting pod/image-registry-5ddfbbb75d-lxkps container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:46:52.789881 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:52.789407 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" podUID="214aced2-0b42-4f85-80a4-81071c853b2b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:46:53.161249 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:53.161216 2574 patch_prober.go:28] interesting pod/image-registry-569f6597b-r6jjd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:46:53.161471 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:53.161266 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podUID="577378d3-e3ab-450e-9958-481dbf218b7e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:46:55.038878 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:55.038843 2574 patch_prober.go:28] interesting pod/image-registry-569f6597b-r6jjd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:46:55.039230 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:55.038897 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podUID="577378d3-e3ab-450e-9958-481dbf218b7e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:46:57.209012 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:57.208968 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:57.209389 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:57.209081 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:46:57.210204 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:57.210177 2574 patch_prober.go:28] interesting pod/console-579d4c657c-pj26n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 12 18:46:57.210343 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:57.210243 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-579d4c657c-pj26n" podUID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 12 18:46:57.802780 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:57.802721 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" podUID="214aced2-0b42-4f85-80a4-81071c853b2b" containerName="registry" containerID="cri-o://3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f" gracePeriod=30 Jun 12 18:46:58.050330 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.050298 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:58.097668 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097576 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-registry-certificates\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.097668 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097617 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-trusted-ca\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.097668 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097643 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-bound-sa-token\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.097668 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097661 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/214aced2-0b42-4f85-80a4-81071c853b2b-ca-trust-extracted\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.097986 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097683 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5gjc\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-kube-api-access-k5gjc\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.097986 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097722 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.097986 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097762 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-installation-pull-secrets\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.097986 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.097815 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-image-registry-private-configuration\") pod \"214aced2-0b42-4f85-80a4-81071c853b2b\" (UID: \"214aced2-0b42-4f85-80a4-81071c853b2b\") " Jun 12 18:46:58.098173 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.098002 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:46:58.098173 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.098075 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:46:58.100256 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.100210 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:46:58.100256 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.100231 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:46:58.100468 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.100351 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:46:58.100522 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.100483 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:46:58.100668 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.100651 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-kube-api-access-k5gjc" (OuterVolumeSpecName: "kube-api-access-k5gjc") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "kube-api-access-k5gjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:46:58.106383 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.106356 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/214aced2-0b42-4f85-80a4-81071c853b2b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "214aced2-0b42-4f85-80a4-81071c853b2b" (UID: "214aced2-0b42-4f85-80a4-81071c853b2b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:46:58.157259 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.157226 2574 generic.go:356] "Generic (PLEG): container finished" podID="214aced2-0b42-4f85-80a4-81071c853b2b" containerID="3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f" exitCode=0 Jun 12 18:46:58.157439 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.157270 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" Jun 12 18:46:58.157439 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.157307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" event={"ID":"214aced2-0b42-4f85-80a4-81071c853b2b","Type":"ContainerDied","Data":"3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f"} Jun 12 18:46:58.157439 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.157347 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddfbbb75d-lxkps" event={"ID":"214aced2-0b42-4f85-80a4-81071c853b2b","Type":"ContainerDied","Data":"63f0fea3ad967d4ea7d5091837a429cbc1adababec7bd70dfbadeed8d2cc8f1a"} Jun 12 18:46:58.157439 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.157366 2574 scope.go:117] "RemoveContainer" containerID="3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f" Jun 12 18:46:58.165695 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.165679 2574 scope.go:117] "RemoveContainer" containerID="3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f" Jun 12 18:46:58.165964 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:46:58.165948 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f\": container with ID starting with 3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f not found: ID does not exist" containerID="3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f" Jun 12 18:46:58.166000 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.165971 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f"} err="failed to get container status \"3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f\": rpc error: code = NotFound desc = could not find container \"3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f\": container with ID starting with 3832c2c3cbef5ad57eff5dd2cb973fe4e7f19571a1ef9a79b5425620d1e1ff7f not found: ID does not exist" Jun 12 18:46:58.177757 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.177727 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5ddfbbb75d-lxkps"] Jun 12 18:46:58.181466 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.181440 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5ddfbbb75d-lxkps"] Jun 12 18:46:58.199009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.198982 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-registry-certificates\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:58.199009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.199004 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/214aced2-0b42-4f85-80a4-81071c853b2b-trusted-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:58.199009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.199013 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-bound-sa-token\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:58.199193 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.199021 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/214aced2-0b42-4f85-80a4-81071c853b2b-ca-trust-extracted\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:58.199193 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.199030 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5gjc\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-kube-api-access-k5gjc\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:58.199193 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.199039 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/214aced2-0b42-4f85-80a4-81071c853b2b-registry-tls\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:58.199193 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.199047 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-installation-pull-secrets\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:58.199193 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:58.199056 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/214aced2-0b42-4f85-80a4-81071c853b2b-image-registry-private-configuration\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:46:59.253785 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:46:59.253752 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="214aced2-0b42-4f85-80a4-81071c853b2b" path="/var/lib/kubelet/pods/214aced2-0b42-4f85-80a4-81071c853b2b/volumes" Jun 12 18:47:03.160966 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:03.160925 2574 patch_prober.go:28] interesting pod/image-registry-569f6597b-r6jjd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:47:03.161342 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:03.160977 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podUID="577378d3-e3ab-450e-9958-481dbf218b7e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:47:04.755710 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:47:04.755669 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tsklz" podUID="659110db-f8d3-454b-a50d-66a0b0ab4047" Jun 12 18:47:05.038955 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:05.038843 2574 patch_prober.go:28] interesting pod/image-registry-569f6597b-r6jjd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:47:05.038955 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:05.038907 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podUID="577378d3-e3ab-450e-9958-481dbf218b7e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:47:05.182160 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:05.182129 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsklz" Jun 12 18:47:07.209181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:07.209141 2574 patch_prober.go:28] interesting pod/console-579d4c657c-pj26n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 12 18:47:07.209640 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:07.209203 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-579d4c657c-pj26n" podUID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 12 18:47:08.683174 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:08.683121 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:47:08.685448 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:08.685428 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/659110db-f8d3-454b-a50d-66a0b0ab4047-metrics-tls\") pod \"dns-default-tsklz\" (UID: \"659110db-f8d3-454b-a50d-66a0b0ab4047\") " pod="openshift-dns/dns-default-tsklz" Jun 12 18:47:08.786221 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:08.786188 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkhgt\"" Jun 12 18:47:08.793514 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:08.793492 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tsklz" Jun 12 18:47:08.934590 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:08.934516 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tsklz"] Jun 12 18:47:08.937702 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:47:08.937675 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659110db_f8d3_454b_a50d_66a0b0ab4047.slice/crio-ea6bc04874d8c5586b970581b086cf3b83cf487f455db1a1a660c2dad7205c52 WatchSource:0}: Error finding container ea6bc04874d8c5586b970581b086cf3b83cf487f455db1a1a660c2dad7205c52: Status 404 returned error can't find the container with id ea6bc04874d8c5586b970581b086cf3b83cf487f455db1a1a660c2dad7205c52 Jun 12 18:47:09.198135 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:09.198049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsklz" event={"ID":"659110db-f8d3-454b-a50d-66a0b0ab4047","Type":"ContainerStarted","Data":"ea6bc04874d8c5586b970581b086cf3b83cf487f455db1a1a660c2dad7205c52"} Jun 12 18:47:11.208059 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:11.208025 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsklz" event={"ID":"659110db-f8d3-454b-a50d-66a0b0ab4047","Type":"ContainerStarted","Data":"9e60f84036a9ced117b85b54590fd0c8bac98e813c70cff9efcafeea75c62559"} Jun 12 18:47:11.208453 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:11.208105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tsklz" event={"ID":"659110db-f8d3-454b-a50d-66a0b0ab4047","Type":"ContainerStarted","Data":"82a2c2295b7a44ebb649fb818f64f13a5be28b429e6a6e1d25055598e932db0b"} Jun 12 18:47:11.208453 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:11.208129 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tsklz" Jun 12 18:47:11.225695 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:11.225648 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tsklz" podStartSLOduration=251.592936095 podStartE2EDuration="4m13.225635025s" totalImagesPullingTime="1.63269893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:47:11.22438139 +0000 UTC m=+288.390775573" watchObservedRunningTime="2026-06-12 18:47:11.225635025 +0000 UTC m=+288.392029187" Jun 12 18:47:13.160547 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:13.160513 2574 patch_prober.go:28] interesting pod/image-registry-569f6597b-r6jjd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:47:13.160923 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:13.160574 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podUID="577378d3-e3ab-450e-9958-481dbf218b7e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:47:13.160923 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:13.160612 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:47:13.161067 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:13.161050 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"0a3a95060b339858e09addd6eecbc967d6ed1c22f4d2c5450153a0eaece57e7c"} pod="openshift-image-registry/image-registry-569f6597b-r6jjd" containerMessage="Container registry failed liveness probe, will be restarted" Jun 12 18:47:13.164751 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:13.164724 2574 patch_prober.go:28] interesting pod/image-registry-569f6597b-r6jjd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:47:13.164891 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:13.164772 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podUID="577378d3-e3ab-450e-9958-481dbf218b7e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:47:17.212884 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:17.212850 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:47:17.216614 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:17.216587 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:47:18.009729 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:18.009697 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/init-config-reloader/0.log" Jun 12 18:47:18.209471 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:18.209443 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/alertmanager/0.log" Jun 12 18:47:18.409176 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:18.409146 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/config-reloader/0.log" Jun 12 18:47:18.609683 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:18.609652 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/kube-rbac-proxy-web/0.log" Jun 12 18:47:18.809686 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:18.809605 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/kube-rbac-proxy/0.log" Jun 12 18:47:19.015056 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:19.015030 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/kube-rbac-proxy-metric/0.log" Jun 12 18:47:19.210010 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:19.209975 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/prom-label-proxy/0.log" Jun 12 18:47:20.409742 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:20.409716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-2xp7r_b511fa76-2d99-40eb-a1c2-9656e8946d4a/monitoring-plugin/0.log" Jun 12 18:47:21.213699 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:21.213664 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tsklz" Jun 12 18:47:21.811083 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:21.811056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x86r_057d930b-506e-4429-9c96-0f6bee836424/init-textfile/0.log" Jun 12 18:47:22.010504 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:22.010465 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x86r_057d930b-506e-4429-9c96-0f6bee836424/node-exporter/0.log" Jun 12 18:47:22.210281 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:22.210255 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x86r_057d930b-506e-4429-9c96-0f6bee836424/kube-rbac-proxy/0.log" Jun 12 18:47:22.409913 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:22.409883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72d8z_59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9/kube-rbac-proxy-main/0.log" Jun 12 18:47:22.609581 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:22.609550 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72d8z_59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9/kube-rbac-proxy-self/0.log" Jun 12 18:47:22.810302 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:22.810261 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72d8z_59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9/openshift-state-metrics/0.log" Jun 12 18:47:23.165361 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:23.165325 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:47:23.207149 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:23.207128 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 18:47:24.812179 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:24.812147 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-rxh2g_6602361d-50a9-450c-8ab7-4f75410c1829/prometheus-operator-admission-webhook/0.log" Jun 12 18:47:26.810483 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:26.810453 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-579d4c657c-pj26n_d3d1d977-356f-48f2-95a4-8e7b878f13e6/console/0.log" Jun 12 18:47:27.810025 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:27.809961 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsklz_659110db-f8d3-454b-a50d-66a0b0ab4047/dns/0.log" Jun 12 18:47:28.009449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:28.009410 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsklz_659110db-f8d3-454b-a50d-66a0b0ab4047/kube-rbac-proxy/0.log" Jun 12 18:47:29.009755 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:29.009727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bdd45_ef686d13-2ae1-4214-b106-af9b65a6d82d/dns-node-resolver/0.log" Jun 12 18:47:29.211249 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:29.211211 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-569f6597b-r6jjd_577378d3-e3ab-450e-9958-481dbf218b7e/registry/0.log" Jun 12 18:47:29.809931 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:29.809902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-czvqp_ffd37509-b8ff-4538-af18-a925ba1bb75f/node-ca/0.log" Jun 12 18:47:30.819337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:30.819309 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlrz5_0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2/serve-healthcheck-canary/0.log" Jun 12 18:47:34.299111 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:34.299022 2574 generic.go:356] "Generic (PLEG): container finished" podID="0588f18a-7918-4c8a-bf48-30e74ce62e00" containerID="371240fc962047f313cb7ef653bcbae0388285efba48dc20a35f1639a92e06f9" exitCode=0 Jun 12 18:47:34.299571 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:34.299106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" event={"ID":"0588f18a-7918-4c8a-bf48-30e74ce62e00","Type":"ContainerDied","Data":"371240fc962047f313cb7ef653bcbae0388285efba48dc20a35f1639a92e06f9"} Jun 12 18:47:34.299637 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:34.299591 2574 scope.go:117] "RemoveContainer" containerID="371240fc962047f313cb7ef653bcbae0388285efba48dc20a35f1639a92e06f9" Jun 12 18:47:35.304527 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:35.304492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-b9sm2" event={"ID":"0588f18a-7918-4c8a-bf48-30e74ce62e00","Type":"ContainerStarted","Data":"477fb5911364c97e3cf39ebd38e1a3f81bbd80881ee4c480556970ba65988749"} Jun 12 18:47:38.179951 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:38.179905 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" podUID="577378d3-e3ab-450e-9958-481dbf218b7e" containerName="registry" containerID="cri-o://0a3a95060b339858e09addd6eecbc967d6ed1c22f4d2c5450153a0eaece57e7c" gracePeriod=30 Jun 12 18:47:39.320951 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:39.320910 2574 generic.go:356] "Generic (PLEG): container finished" podID="577378d3-e3ab-450e-9958-481dbf218b7e" containerID="0a3a95060b339858e09addd6eecbc967d6ed1c22f4d2c5450153a0eaece57e7c" exitCode=0 Jun 12 18:47:39.321302 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:39.320983 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" event={"ID":"577378d3-e3ab-450e-9958-481dbf218b7e","Type":"ContainerDied","Data":"0a3a95060b339858e09addd6eecbc967d6ed1c22f4d2c5450153a0eaece57e7c"} Jun 12 18:47:40.326851 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:40.326819 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" event={"ID":"577378d3-e3ab-450e-9958-481dbf218b7e","Type":"ContainerStarted","Data":"9ccb12b22a0a2f16fdb5340a9617d1f08e398263185b4c6f7fe2eaf93ee306af"} Jun 12 18:47:40.327260 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:47:40.326948 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:48:00.441135 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:00.441101 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:48:00.441578 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:00.441398 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="alertmanager" containerID="cri-o://93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac" gracePeriod=120 Jun 12 18:48:00.441578 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:00.441453 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-metric" containerID="cri-o://79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed" gracePeriod=120 Jun 12 18:48:00.441578 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:00.441494 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="prom-label-proxy" containerID="cri-o://6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c" gracePeriod=120 Jun 12 18:48:00.441578 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:00.441507 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-web" containerID="cri-o://dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e" gracePeriod=120 Jun 12 18:48:00.441578 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:00.441545 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy" containerID="cri-o://aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b" gracePeriod=120 Jun 12 18:48:00.441849 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:00.441558 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="config-reloader" containerID="cri-o://f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97" gracePeriod=120 Jun 12 18:48:01.334709 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.334674 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-569f6597b-r6jjd" Jun 12 18:48:01.408964 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.408923 2574 generic.go:356] "Generic (PLEG): container finished" podID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerID="6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c" exitCode=0 Jun 12 18:48:01.408964 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.408954 2574 generic.go:356] "Generic (PLEG): container finished" podID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerID="aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b" exitCode=0 Jun 12 18:48:01.408964 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.408963 2574 generic.go:356] "Generic (PLEG): container finished" podID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerID="f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97" exitCode=0 Jun 12 18:48:01.408964 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.408974 2574 generic.go:356] "Generic (PLEG): container finished" podID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerID="93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac" exitCode=0 Jun 12 18:48:01.409306 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.409002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c"} Jun 12 18:48:01.409306 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.409098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b"} Jun 12 18:48:01.409306 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.409141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97"} Jun 12 18:48:01.409306 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.409182 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac"} Jun 12 18:48:01.683330 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.683302 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:01.806427 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806347 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806427 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806397 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-main-db\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806430 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-metrics-client-ca\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806460 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-tls-assets\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806482 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-web-config\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806502 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx465\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-kube-api-access-wx465\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806547 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806579 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-cluster-tls-config\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806606 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.806642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806631 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-volume\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.807057 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806654 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.807057 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806725 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-web\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.807057 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806784 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-out\") pod \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\" (UID: \"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a\") " Jun 12 18:48:01.807057 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.806784 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:48:01.807057 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.807013 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-main-db\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.807324 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.807087 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:48:01.807691 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.807431 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:48:01.810131 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.810071 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-volume" (OuterVolumeSpecName: "config-volume") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:01.810309 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.810263 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-kube-api-access-wx465" (OuterVolumeSpecName: "kube-api-access-wx465") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "kube-api-access-wx465". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:48:01.810567 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.810522 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:01.810804 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.810766 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:01.811159 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.811097 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:01.811408 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.811376 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:48:01.811648 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.811621 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-out" (OuterVolumeSpecName: "config-out") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:48:01.812172 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.812146 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:01.814594 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.814476 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:01.822021 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.821989 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-web-config" (OuterVolumeSpecName: "web-config") pod "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" (UID: "5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:01.908251 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908203 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-cluster-tls-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908251 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908244 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908251 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908254 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-volume\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908251 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908263 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908272 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908281 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-config-out\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908312 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908321 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-metrics-client-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908329 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-tls-assets\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908337 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-web-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908344 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx465\" (UniqueName: \"kubernetes.io/projected/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-kube-api-access-wx465\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:01.908539 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:01.908353 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a-secret-alertmanager-main-tls\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:02.415348 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.415310 2574 generic.go:356] "Generic (PLEG): container finished" podID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerID="79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed" exitCode=0 Jun 12 18:48:02.415348 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.415345 2574 generic.go:356] "Generic (PLEG): container finished" podID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerID="dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e" exitCode=0 Jun 12 18:48:02.415545 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.415387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed"} Jun 12 18:48:02.415545 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.415457 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e"} Jun 12 18:48:02.415545 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.415397 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.415545 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.415483 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a","Type":"ContainerDied","Data":"537fc7592c7708a7295081b75aac82d679eacbb5433c84e84b2995d941465323"} Jun 12 18:48:02.415545 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.415515 2574 scope.go:117] "RemoveContainer" containerID="6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c" Jun 12 18:48:02.423555 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.423534 2574 scope.go:117] "RemoveContainer" containerID="79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed" Jun 12 18:48:02.431185 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.431167 2574 scope.go:117] "RemoveContainer" containerID="aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b" Jun 12 18:48:02.438003 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.437984 2574 scope.go:117] "RemoveContainer" containerID="dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e" Jun 12 18:48:02.443419 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.443394 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:48:02.445538 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.445508 2574 scope.go:117] "RemoveContainer" containerID="f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97" Jun 12 18:48:02.447767 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.447742 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:48:02.453207 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.453177 2574 scope.go:117] "RemoveContainer" containerID="93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac" Jun 12 18:48:02.460295 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.460261 2574 scope.go:117] "RemoveContainer" containerID="20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad" Jun 12 18:48:02.467565 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.467545 2574 scope.go:117] "RemoveContainer" containerID="6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c" Jun 12 18:48:02.467839 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:02.467818 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c\": container with ID starting with 6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c not found: ID does not exist" containerID="6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c" Jun 12 18:48:02.467909 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.467853 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c"} err="failed to get container status \"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c\": rpc error: code = NotFound desc = could not find container \"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c\": container with ID starting with 6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c not found: ID does not exist" Jun 12 18:48:02.467909 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.467879 2574 scope.go:117] "RemoveContainer" containerID="79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed" Jun 12 18:48:02.468123 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:02.468107 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed\": container with ID starting with 79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed not found: ID does not exist" containerID="79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed" Jun 12 18:48:02.468184 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468129 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed"} err="failed to get container status \"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed\": rpc error: code = NotFound desc = could not find container \"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed\": container with ID starting with 79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed not found: ID does not exist" Jun 12 18:48:02.468184 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468149 2574 scope.go:117] "RemoveContainer" containerID="aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b" Jun 12 18:48:02.468432 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:02.468415 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b\": container with ID starting with aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b not found: ID does not exist" containerID="aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b" Jun 12 18:48:02.468486 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468437 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b"} err="failed to get container status \"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b\": rpc error: code = NotFound desc = could not find container \"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b\": container with ID starting with aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b not found: ID does not exist" Jun 12 18:48:02.468486 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468451 2574 scope.go:117] "RemoveContainer" containerID="dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e" Jun 12 18:48:02.468717 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:02.468697 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e\": container with ID starting with dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e not found: ID does not exist" containerID="dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e" Jun 12 18:48:02.468772 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468722 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e"} err="failed to get container status \"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e\": rpc error: code = NotFound desc = could not find container \"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e\": container with ID starting with dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e not found: ID does not exist" Jun 12 18:48:02.468772 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468741 2574 scope.go:117] "RemoveContainer" containerID="f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97" Jun 12 18:48:02.468973 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:02.468957 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97\": container with ID starting with f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97 not found: ID does not exist" containerID="f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97" Jun 12 18:48:02.469014 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468977 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97"} err="failed to get container status \"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97\": rpc error: code = NotFound desc = could not find container \"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97\": container with ID starting with f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97 not found: ID does not exist" Jun 12 18:48:02.469014 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.468990 2574 scope.go:117] "RemoveContainer" containerID="93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac" Jun 12 18:48:02.469228 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:02.469211 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac\": container with ID starting with 93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac not found: ID does not exist" containerID="93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac" Jun 12 18:48:02.469270 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469240 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac"} err="failed to get container status \"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac\": rpc error: code = NotFound desc = could not find container \"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac\": container with ID starting with 93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac not found: ID does not exist" Jun 12 18:48:02.469270 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469254 2574 scope.go:117] "RemoveContainer" containerID="20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad" Jun 12 18:48:02.469494 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:02.469480 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad\": container with ID starting with 20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad not found: ID does not exist" containerID="20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad" Jun 12 18:48:02.469534 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469499 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad"} err="failed to get container status \"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad\": rpc error: code = NotFound desc = could not find container \"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad\": container with ID starting with 20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad not found: ID does not exist" Jun 12 18:48:02.469534 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469511 2574 scope.go:117] "RemoveContainer" containerID="6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c" Jun 12 18:48:02.469707 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469691 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c"} err="failed to get container status \"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c\": rpc error: code = NotFound desc = could not find container \"6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c\": container with ID starting with 6991550022fb1e5598fd531a017687ff3d036996cc0497249a1af8816db2df3c not found: ID does not exist" Jun 12 18:48:02.469745 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469706 2574 scope.go:117] "RemoveContainer" containerID="79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed" Jun 12 18:48:02.469888 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469873 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed"} err="failed to get container status \"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed\": rpc error: code = NotFound desc = could not find container \"79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed\": container with ID starting with 79595f6903aa92c7672027b985cf0caf966dbce6dbda2d54c30458ec14d9f8ed not found: ID does not exist" Jun 12 18:48:02.469932 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.469887 2574 scope.go:117] "RemoveContainer" containerID="aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b" Jun 12 18:48:02.470051 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470035 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b"} err="failed to get container status \"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b\": rpc error: code = NotFound desc = could not find container \"aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b\": container with ID starting with aef1add55b55d4ee5d72f1df870a1d23c8fa80ea87f2cf7e8db6a78fb7969b5b not found: ID does not exist" Jun 12 18:48:02.470094 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470052 2574 scope.go:117] "RemoveContainer" containerID="dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e" Jun 12 18:48:02.470258 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470243 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e"} err="failed to get container status \"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e\": rpc error: code = NotFound desc = could not find container \"dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e\": container with ID starting with dc36fc0d7ed46b4f7d06eaf8a04704616a33803af1816f1416dd5f1eecc0696e not found: ID does not exist" Jun 12 18:48:02.470258 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470258 2574 scope.go:117] "RemoveContainer" containerID="f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97" Jun 12 18:48:02.470507 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470488 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97"} err="failed to get container status \"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97\": rpc error: code = NotFound desc = could not find container \"f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97\": container with ID starting with f9b54e41b531a72b483d51c48a45ac08a6ea2a8e72dc3da16b5fe64eb5b3ff97 not found: ID does not exist" Jun 12 18:48:02.470564 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470508 2574 scope.go:117] "RemoveContainer" containerID="93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac" Jun 12 18:48:02.470795 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470773 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac"} err="failed to get container status \"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac\": rpc error: code = NotFound desc = could not find container \"93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac\": container with ID starting with 93467e9c32cfd361906f498d7c5771112bec5dea7e80a6075b19e5d9a6d4feac not found: ID does not exist" Jun 12 18:48:02.470970 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.470797 2574 scope.go:117] "RemoveContainer" containerID="20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad" Jun 12 18:48:02.471154 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.471126 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad"} err="failed to get container status \"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad\": rpc error: code = NotFound desc = could not find container \"20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad\": container with ID starting with 20816320fd7a31fed8ac51904aae8209fbbfbff55b90ab10010b6493f2bd14ad not found: ID does not exist" Jun 12 18:48:02.473552 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473532 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:48:02.473775 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473764 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-web" Jun 12 18:48:02.473816 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473778 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-web" Jun 12 18:48:02.473816 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473787 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="214aced2-0b42-4f85-80a4-81071c853b2b" containerName="registry" Jun 12 18:48:02.473816 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473793 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="214aced2-0b42-4f85-80a4-81071c853b2b" containerName="registry" Jun 12 18:48:02.473816 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473799 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="alertmanager" Jun 12 18:48:02.473816 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473804 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="alertmanager" Jun 12 18:48:02.473816 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473812 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="init-config-reloader" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473818 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="init-config-reloader" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473824 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-metric" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473828 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-metric" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473835 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="prom-label-proxy" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473840 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="prom-label-proxy" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473853 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473858 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473865 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="config-reloader" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473870 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="config-reloader" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473906 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="214aced2-0b42-4f85-80a4-81071c853b2b" containerName="registry" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473913 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473920 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-metric" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473926 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="prom-label-proxy" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473931 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="alertmanager" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473937 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="config-reloader" Jun 12 18:48:02.473985 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.473941 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" containerName="kube-rbac-proxy-web" Jun 12 18:48:02.477681 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.477666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.480371 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480351 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r7gr5\"" Jun 12 18:48:02.480476 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480376 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 18:48:02.480476 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480466 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 18:48:02.480580 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480472 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 18:48:02.480580 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480515 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 18:48:02.480580 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480532 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 18:48:02.480580 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480577 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 18:48:02.480859 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480844 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 18:48:02.480914 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.480862 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 18:48:02.485974 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.485954 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 18:48:02.491978 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.491958 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:48:02.613275 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgmbq\" (UniqueName: \"kubernetes.io/projected/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-kube-api-access-jgmbq\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613275 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613504 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-config-out\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613504 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613504 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613504 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-web-config\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613504 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613654 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613654 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613654 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613554 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613654 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613654 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.613797 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.613685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.714583 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.714583 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgmbq\" (UniqueName: \"kubernetes.io/projected/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-kube-api-access-jgmbq\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.714583 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.714583 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-config-out\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.714583 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.714583 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-web-config\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715325 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.714926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.715755 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.715731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.717885 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.717853 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.717885 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.717876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-web-config\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718047 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.717858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718047 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.717955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718245 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.718119 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.718342 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718567 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.718539 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718662 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.718539 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-config-out\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718798 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.718780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.718840 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.718810 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.719823 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.719806 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.724135 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.724112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgmbq\" (UniqueName: \"kubernetes.io/projected/6bb778a5-b2ee-4b44-aeff-97ee227fccdc-kube-api-access-jgmbq\") pod \"alertmanager-main-0\" (UID: \"6bb778a5-b2ee-4b44-aeff-97ee227fccdc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.787259 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.787214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:48:02.926747 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:02.926717 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:48:02.928501 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:48:02.928474 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb778a5_b2ee_4b44_aeff_97ee227fccdc.slice/crio-095eb86294966ace8cd90f1f030b00d35d7202c6ab7e7c6e730900c3e871b971 WatchSource:0}: Error finding container 095eb86294966ace8cd90f1f030b00d35d7202c6ab7e7c6e730900c3e871b971: Status 404 returned error can't find the container with id 095eb86294966ace8cd90f1f030b00d35d7202c6ab7e7c6e730900c3e871b971 Jun 12 18:48:03.255726 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:03.255649 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a" path="/var/lib/kubelet/pods/5fd6ed1f-16a1-44b1-8108-5ec4ad4ab05a/volumes" Jun 12 18:48:03.424378 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:03.424345 2574 generic.go:356] "Generic (PLEG): container finished" podID="6bb778a5-b2ee-4b44-aeff-97ee227fccdc" containerID="bf6d3e0f2518fb971217e64c84c1f6b871db2e40c9cb3e39d9aaa61b23e7d7ce" exitCode=0 Jun 12 18:48:03.424525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:03.424399 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerDied","Data":"bf6d3e0f2518fb971217e64c84c1f6b871db2e40c9cb3e39d9aaa61b23e7d7ce"} Jun 12 18:48:03.424525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:03.424472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerStarted","Data":"095eb86294966ace8cd90f1f030b00d35d7202c6ab7e7c6e730900c3e871b971"} Jun 12 18:48:04.431251 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.431217 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerStarted","Data":"377e53a7c553173a3737a618eac4de8bd8ae3c192bf98af616cca1f671a680da"} Jun 12 18:48:04.431643 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.431336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerStarted","Data":"f7b6a5e01ea4be08acd453a1c3e977c95e7a07394f20eba88d808480319a8b6e"} Jun 12 18:48:04.431643 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.431366 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerStarted","Data":"7745ed7f4e1658f94730cb13ef00d5d80884c2ef2bfe5ea3ccc99bcb6e45129d"} Jun 12 18:48:04.431643 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.431389 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerStarted","Data":"0f55bf179a0018ba6fd442c7af702c0fc8a93f86ebe7d6b592e564caecdb6e76"} Jun 12 18:48:04.431643 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.431412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerStarted","Data":"d337db315d61fa2a7ca9f1457da30787304e46a528a6ed4f936261b1a087d924"} Jun 12 18:48:04.431643 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.431437 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bb778a5-b2ee-4b44-aeff-97ee227fccdc","Type":"ContainerStarted","Data":"48676bc74a723719145d728f87bb6975e77ea0a624c2c893d9d357ebc8d17794"} Jun 12 18:48:04.462811 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.462755 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.446482546 podStartE2EDuration="2.462738584s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.256038ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:48:04.462276511 +0000 UTC m=+341.628670690" watchObservedRunningTime="2026-06-12 18:48:04.462738584 +0000 UTC m=+341.629132748" Jun 12 18:48:04.470101 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.467510 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c7fd99c69-2trjv"] Jun 12 18:48:04.471939 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.471911 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.474575 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.474543 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 18:48:04.474716 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.474604 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 18:48:04.474716 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.474612 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 18:48:04.474716 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.474618 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 18:48:04.474906 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.474887 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 18:48:04.475257 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.475240 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fp7sd\"" Jun 12 18:48:04.480121 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.480098 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 18:48:04.485168 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.485140 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7fd99c69-2trjv"] Jun 12 18:48:04.528600 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.528566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.528794 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.528632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlpv7\" (UniqueName: \"kubernetes.io/projected/193f73ed-438b-4722-8ded-ccd055f4a43b-kube-api-access-vlpv7\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.528794 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.528745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-metrics-client-ca\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.528917 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.528796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-serving-certs-ca-bundle\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.528917 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.528827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.528917 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.528859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-secret-telemeter-client\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.529157 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.529110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-federate-client-tls\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.529354 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.529328 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-telemeter-client-tls\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.629924 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.629884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-federate-client-tls\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.629924 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.629927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-telemeter-client-tls\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.630151 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.629952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.630151 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.629977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpv7\" (UniqueName: \"kubernetes.io/projected/193f73ed-438b-4722-8ded-ccd055f4a43b-kube-api-access-vlpv7\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.630151 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.630092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-metrics-client-ca\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.630151 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.630132 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-serving-certs-ca-bundle\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.630404 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.630161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.630404 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.630190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-secret-telemeter-client\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.630915 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.630886 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-serving-certs-ca-bundle\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.631041 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.630950 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-metrics-client-ca\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.631132 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.631101 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f73ed-438b-4722-8ded-ccd055f4a43b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.632514 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.632484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-telemeter-client-tls\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.632635 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.632613 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-federate-client-tls\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.632708 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.632676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.632756 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.632739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/193f73ed-438b-4722-8ded-ccd055f4a43b-secret-telemeter-client\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.638682 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.638647 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlpv7\" (UniqueName: \"kubernetes.io/projected/193f73ed-438b-4722-8ded-ccd055f4a43b-kube-api-access-vlpv7\") pod \"telemeter-client-5c7fd99c69-2trjv\" (UID: \"193f73ed-438b-4722-8ded-ccd055f4a43b\") " pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.784242 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.784153 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" Jun 12 18:48:04.923435 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.923356 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7fd99c69-2trjv"] Jun 12 18:48:04.925911 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:48:04.925884 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193f73ed_438b_4722_8ded_ccd055f4a43b.slice/crio-d80ef3411481867909123f238758ef60867539ce382ec0fedf6144c574d541a0 WatchSource:0}: Error finding container d80ef3411481867909123f238758ef60867539ce382ec0fedf6144c574d541a0: Status 404 returned error can't find the container with id d80ef3411481867909123f238758ef60867539ce382ec0fedf6144c574d541a0 Jun 12 18:48:04.927821 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:04.927806 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:48:05.436423 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:05.436388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" event={"ID":"193f73ed-438b-4722-8ded-ccd055f4a43b","Type":"ContainerStarted","Data":"d80ef3411481867909123f238758ef60867539ce382ec0fedf6144c574d541a0"} Jun 12 18:48:07.448114 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:07.448079 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" event={"ID":"193f73ed-438b-4722-8ded-ccd055f4a43b","Type":"ContainerStarted","Data":"1b1325ff77a361716972ecf0ac7fd447dd0c489aa33dd58c3940c6b052cae9a2"} Jun 12 18:48:07.448514 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:07.448146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" event={"ID":"193f73ed-438b-4722-8ded-ccd055f4a43b","Type":"ContainerStarted","Data":"a5f5aeda69c76f58cef77dd540dc4799a32d75e9053f128cfd5bd809e9440fce"} Jun 12 18:48:07.448514 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:07.448174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" event={"ID":"193f73ed-438b-4722-8ded-ccd055f4a43b","Type":"ContainerStarted","Data":"e9f8e9d5c81cb4c278a07211da75b28384f9d3df1185575e32e41fe71b26daa9"} Jun 12 18:48:07.472049 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:07.471995 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c7fd99c69-2trjv" podStartSLOduration=1.3574409379999999 podStartE2EDuration="3.471978853s" totalImagesPullingTime="2.114537915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:48:07.470615805 +0000 UTC m=+344.637009967" watchObservedRunningTime="2026-06-12 18:48:07.471978853 +0000 UTC m=+344.638373015" Jun 12 18:48:08.139475 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.139420 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbbb8b7c8-f62qg"] Jun 12 18:48:08.142769 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.142751 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.155934 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.155904 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbbb8b7c8-f62qg"] Jun 12 18:48:08.259080 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.259048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-oauth-config\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.259080 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.259084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-service-ca\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.259339 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.259109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-serving-cert\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.259339 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.259171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-config\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.259339 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.259211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-oauth-serving-cert\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.259339 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.259234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-trusted-ca-bundle\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.259339 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.259325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrrv\" (UniqueName: \"kubernetes.io/projected/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-kube-api-access-rvrrv\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.360764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.360703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-oauth-config\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.360764 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.360758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-service-ca\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.360788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-serving-cert\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.360810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-config\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.360826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-oauth-serving-cert\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.360843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-trusted-ca-bundle\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361009 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.360881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrrv\" (UniqueName: \"kubernetes.io/projected/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-kube-api-access-rvrrv\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361591 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.361566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-config\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361691 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.361613 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-service-ca\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361691 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.361666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-oauth-serving-cert\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.361770 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.361721 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-trusted-ca-bundle\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.363427 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.363397 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-serving-cert\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.363427 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.363421 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-oauth-config\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.369555 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.369533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrrv\" (UniqueName: \"kubernetes.io/projected/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-kube-api-access-rvrrv\") pod \"console-6fbbb8b7c8-f62qg\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.451828 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.451731 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:08.590003 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:08.589871 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbbb8b7c8-f62qg"] Jun 12 18:48:08.592630 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:48:08.592600 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf79b1ea5_a60a_455b_a65e_5cd66d22fcf6.slice/crio-9e37bc79606b1974eaf233b52b6af2dde637c23d91952ca027055ab4915d80fa WatchSource:0}: Error finding container 9e37bc79606b1974eaf233b52b6af2dde637c23d91952ca027055ab4915d80fa: Status 404 returned error can't find the container with id 9e37bc79606b1974eaf233b52b6af2dde637c23d91952ca027055ab4915d80fa Jun 12 18:48:09.457183 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:09.457146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbbb8b7c8-f62qg" event={"ID":"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6","Type":"ContainerStarted","Data":"2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a"} Jun 12 18:48:09.457754 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:09.457199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbbb8b7c8-f62qg" event={"ID":"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6","Type":"ContainerStarted","Data":"9e37bc79606b1974eaf233b52b6af2dde637c23d91952ca027055ab4915d80fa"} Jun 12 18:48:09.477702 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:09.477650 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fbbb8b7c8-f62qg" podStartSLOduration=1.477634825 podStartE2EDuration="1.477634825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:48:09.475656306 +0000 UTC m=+346.642050468" watchObservedRunningTime="2026-06-12 18:48:09.477634825 +0000 UTC m=+346.644028987" Jun 12 18:48:18.452642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:18.452586 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:18.453060 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:18.452670 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:18.457549 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:18.457523 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:18.500815 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:18.500782 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:48:18.547570 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:18.547533 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579d4c657c-pj26n"] Jun 12 18:48:43.571959 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.571894 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-579d4c657c-pj26n" podUID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" containerName="console" containerID="cri-o://4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede" gracePeriod=15 Jun 12 18:48:43.808214 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.808187 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:48:43.854739 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.854636 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49r7s\" (UniqueName: \"kubernetes.io/projected/d3d1d977-356f-48f2-95a4-8e7b878f13e6-kube-api-access-49r7s\") pod \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " Jun 12 18:48:43.854739 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.854689 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-config\") pod \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " Jun 12 18:48:43.854739 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.854731 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-service-ca\") pod \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " Jun 12 18:48:43.854997 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.854779 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-trusted-ca-bundle\") pod \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " Jun 12 18:48:43.854997 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.854800 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-oauth-serving-cert\") pod \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " Jun 12 18:48:43.854997 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.854944 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-serving-cert\") pod \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " Jun 12 18:48:43.855126 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855027 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-oauth-config\") pod \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\" (UID: \"d3d1d977-356f-48f2-95a4-8e7b878f13e6\") " Jun 12 18:48:43.855182 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855118 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-config" (OuterVolumeSpecName: "console-config") pod "d3d1d977-356f-48f2-95a4-8e7b878f13e6" (UID: "d3d1d977-356f-48f2-95a4-8e7b878f13e6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:48:43.855182 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855149 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3d1d977-356f-48f2-95a4-8e7b878f13e6" (UID: "d3d1d977-356f-48f2-95a4-8e7b878f13e6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:48:43.855317 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855188 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3d1d977-356f-48f2-95a4-8e7b878f13e6" (UID: "d3d1d977-356f-48f2-95a4-8e7b878f13e6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:48:43.855317 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855201 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3d1d977-356f-48f2-95a4-8e7b878f13e6" (UID: "d3d1d977-356f-48f2-95a4-8e7b878f13e6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:48:43.855426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855340 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-trusted-ca-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:43.855426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855354 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-oauth-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:43.855426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855364 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:43.855426 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.855372 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1d977-356f-48f2-95a4-8e7b878f13e6-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:43.857036 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.857016 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3d1d977-356f-48f2-95a4-8e7b878f13e6" (UID: "d3d1d977-356f-48f2-95a4-8e7b878f13e6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:43.857109 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.857068 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d1d977-356f-48f2-95a4-8e7b878f13e6-kube-api-access-49r7s" (OuterVolumeSpecName: "kube-api-access-49r7s") pod "d3d1d977-356f-48f2-95a4-8e7b878f13e6" (UID: "d3d1d977-356f-48f2-95a4-8e7b878f13e6"). InnerVolumeSpecName "kube-api-access-49r7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:48:43.857148 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.857132 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3d1d977-356f-48f2-95a4-8e7b878f13e6" (UID: "d3d1d977-356f-48f2-95a4-8e7b878f13e6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:48:43.955741 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.955704 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49r7s\" (UniqueName: \"kubernetes.io/projected/d3d1d977-356f-48f2-95a4-8e7b878f13e6-kube-api-access-49r7s\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:43.955741 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.955734 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:43.955741 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:43.955743 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1d977-356f-48f2-95a4-8e7b878f13e6-console-oauth-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:48:44.597996 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.597963 2574 generic.go:356] "Generic (PLEG): container finished" podID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" containerID="4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede" exitCode=0 Jun 12 18:48:44.597996 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.598000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d4c657c-pj26n" event={"ID":"d3d1d977-356f-48f2-95a4-8e7b878f13e6","Type":"ContainerDied","Data":"4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede"} Jun 12 18:48:44.598525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.598005 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579d4c657c-pj26n" Jun 12 18:48:44.598525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.598036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579d4c657c-pj26n" event={"ID":"d3d1d977-356f-48f2-95a4-8e7b878f13e6","Type":"ContainerDied","Data":"d8ca2f7ba660b627e7be3b683e34f92e3458e1074519d261612c377e57e4bec7"} Jun 12 18:48:44.598525 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.598055 2574 scope.go:117] "RemoveContainer" containerID="4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede" Jun 12 18:48:44.607153 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.607135 2574 scope.go:117] "RemoveContainer" containerID="4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede" Jun 12 18:48:44.607465 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:48:44.607446 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede\": container with ID starting with 4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede not found: ID does not exist" containerID="4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede" Jun 12 18:48:44.607526 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.607473 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede"} err="failed to get container status \"4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede\": rpc error: code = NotFound desc = could not find container \"4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede\": container with ID starting with 4e7eb53097b7c322ce81eaf0eed09189ebe8f259dfef4b5bb1f316b70f41cede not found: ID does not exist" Jun 12 18:48:44.618867 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.618833 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579d4c657c-pj26n"] Jun 12 18:48:44.625697 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:44.625672 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-579d4c657c-pj26n"] Jun 12 18:48:45.253716 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:48:45.253682 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" path="/var/lib/kubelet/pods/d3d1d977-356f-48f2-95a4-8e7b878f13e6/volumes" Jun 12 18:49:29.604669 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.604632 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fb55f9bb-5n482"] Jun 12 18:49:29.605076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.604910 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" containerName="console" Jun 12 18:49:29.605076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.604921 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" containerName="console" Jun 12 18:49:29.605076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.604983 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3d1d977-356f-48f2-95a4-8e7b878f13e6" containerName="console" Jun 12 18:49:29.609118 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.609096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.630979 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.630947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fb55f9bb-5n482"] Jun 12 18:49:29.634910 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.634883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-service-ca\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.635065 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.634915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-trusted-ca-bundle\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.635065 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.634936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-oauth-config\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.635065 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.634970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr8sf\" (UniqueName: \"kubernetes.io/projected/cdefda6e-745a-4b65-9380-020abc77fa9d-kube-api-access-wr8sf\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.635065 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.635041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-console-config\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.635065 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.635063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-serving-cert\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.635344 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.635080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-oauth-serving-cert\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.736355 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.736315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-serving-cert\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.736355 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.736356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-oauth-serving-cert\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.736611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.736380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-service-ca\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.736611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.736397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-trusted-ca-bundle\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.736611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.736412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-oauth-config\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.736611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.736438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr8sf\" (UniqueName: \"kubernetes.io/projected/cdefda6e-745a-4b65-9380-020abc77fa9d-kube-api-access-wr8sf\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.736611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.736494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-console-config\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.737269 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.737239 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-service-ca\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.737269 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.737259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-oauth-serving-cert\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.737445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.737267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-console-config\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.737445 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.737414 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-trusted-ca-bundle\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.738792 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.738770 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-oauth-config\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.738932 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.738914 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-serving-cert\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.749250 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.749220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr8sf\" (UniqueName: \"kubernetes.io/projected/cdefda6e-745a-4b65-9380-020abc77fa9d-kube-api-access-wr8sf\") pod \"console-57fb55f9bb-5n482\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:29.918848 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:29.918802 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:30.060113 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:30.060080 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fb55f9bb-5n482"] Jun 12 18:49:30.063119 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:49:30.063096 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdefda6e_745a_4b65_9380_020abc77fa9d.slice/crio-310d7acaaec79fbfbc1b23f8aad8e4afece8146702d2a32022cd5c5ac92e3253 WatchSource:0}: Error finding container 310d7acaaec79fbfbc1b23f8aad8e4afece8146702d2a32022cd5c5ac92e3253: Status 404 returned error can't find the container with id 310d7acaaec79fbfbc1b23f8aad8e4afece8146702d2a32022cd5c5ac92e3253 Jun 12 18:49:30.772555 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:30.772473 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fb55f9bb-5n482" event={"ID":"cdefda6e-745a-4b65-9380-020abc77fa9d","Type":"ContainerStarted","Data":"73ed6fe5c6dab96d827c99f90ca3008ecaeb63281e0e6b1b66cff76df9e4b62c"} Jun 12 18:49:30.772555 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:30.772532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fb55f9bb-5n482" event={"ID":"cdefda6e-745a-4b65-9380-020abc77fa9d","Type":"ContainerStarted","Data":"310d7acaaec79fbfbc1b23f8aad8e4afece8146702d2a32022cd5c5ac92e3253"} Jun 12 18:49:30.794992 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:30.794927 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fb55f9bb-5n482" podStartSLOduration=1.794911961 podStartE2EDuration="1.794911961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:49:30.793265437 +0000 UTC m=+427.959659599" watchObservedRunningTime="2026-06-12 18:49:30.794911961 +0000 UTC m=+427.961306122" Jun 12 18:49:39.919378 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:39.919338 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:39.919828 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:39.919402 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:39.924367 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:39.924341 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:40.820276 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:40.820245 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:49:40.875191 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:49:40.875151 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbbb8b7c8-f62qg"] Jun 12 18:50:05.901111 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:05.901058 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fbbb8b7c8-f62qg" podUID="f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" containerName="console" containerID="cri-o://2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a" gracePeriod=15 Jun 12 18:50:06.146494 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.146468 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:50:06.244952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.244857 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-service-ca\") pod \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " Jun 12 18:50:06.244952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.244903 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-serving-cert\") pod \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " Jun 12 18:50:06.244952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.244921 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-oauth-serving-cert\") pod \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " Jun 12 18:50:06.244952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.244956 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvrrv\" (UniqueName: \"kubernetes.io/projected/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-kube-api-access-rvrrv\") pod \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " Jun 12 18:50:06.245311 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.245025 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-oauth-config\") pod \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " Jun 12 18:50:06.245311 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.245048 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-config\") pod \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " Jun 12 18:50:06.245311 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.245074 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-trusted-ca-bundle\") pod \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\" (UID: \"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6\") " Jun 12 18:50:06.245486 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.245332 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-service-ca" (OuterVolumeSpecName: "service-ca") pod "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" (UID: "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:50:06.245486 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.245381 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" (UID: "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:50:06.245592 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.245551 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-config" (OuterVolumeSpecName: "console-config") pod "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" (UID: "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:50:06.245654 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.245626 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" (UID: "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:50:06.247456 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.247429 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" (UID: "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:50:06.247456 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.247439 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-kube-api-access-rvrrv" (OuterVolumeSpecName: "kube-api-access-rvrrv") pod "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" (UID: "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6"). InnerVolumeSpecName "kube-api-access-rvrrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:50:06.247587 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.247526 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" (UID: "f79b1ea5-a60a-455b-a65e-5cd66d22fcf6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:50:06.346356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.346320 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:06.346356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.346351 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:06.346356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.346361 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-oauth-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:06.346588 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.346401 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvrrv\" (UniqueName: \"kubernetes.io/projected/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-kube-api-access-rvrrv\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:06.346588 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.346418 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-oauth-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:06.346588 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.346428 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-console-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:06.346588 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.346435 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6-trusted-ca-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:06.917845 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.917812 2574 generic.go:356] "Generic (PLEG): container finished" podID="f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" containerID="2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a" exitCode=0 Jun 12 18:50:06.918373 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.917867 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbbb8b7c8-f62qg" Jun 12 18:50:06.918373 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.917895 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbbb8b7c8-f62qg" event={"ID":"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6","Type":"ContainerDied","Data":"2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a"} Jun 12 18:50:06.918373 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.917960 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbbb8b7c8-f62qg" event={"ID":"f79b1ea5-a60a-455b-a65e-5cd66d22fcf6","Type":"ContainerDied","Data":"9e37bc79606b1974eaf233b52b6af2dde637c23d91952ca027055ab4915d80fa"} Jun 12 18:50:06.918373 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.917993 2574 scope.go:117] "RemoveContainer" containerID="2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a" Jun 12 18:50:06.929181 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.928818 2574 scope.go:117] "RemoveContainer" containerID="2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a" Jun 12 18:50:06.929544 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:50:06.929520 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a\": container with ID starting with 2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a not found: ID does not exist" containerID="2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a" Jun 12 18:50:06.929616 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.929556 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a"} err="failed to get container status \"2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a\": rpc error: code = NotFound desc = could not find container \"2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a\": container with ID starting with 2341ce474ceb8a2f969537f8554f9722b9cbe0fa0e56889afe20d04bea48036a not found: ID does not exist" Jun 12 18:50:06.941039 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.941011 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbbb8b7c8-f62qg"] Jun 12 18:50:06.946406 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:06.946381 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbbb8b7c8-f62qg"] Jun 12 18:50:07.254590 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:07.254494 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" path="/var/lib/kubelet/pods/f79b1ea5-a60a-455b-a65e-5cd66d22fcf6/volumes" Jun 12 18:50:17.421164 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.421127 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559"] Jun 12 18:50:17.421659 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.421601 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" containerName="console" Jun 12 18:50:17.421659 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.421619 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" containerName="console" Jun 12 18:50:17.421817 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.421696 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f79b1ea5-a60a-455b-a65e-5cd66d22fcf6" containerName="console" Jun 12 18:50:17.426121 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.426100 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.429019 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.428997 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 18:50:17.430183 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.430165 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x9fn8\"" Jun 12 18:50:17.430260 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.430172 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 18:50:17.434082 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.434058 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559"] Jun 12 18:50:17.535952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.535915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.536157 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.536003 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv8dm\" (UniqueName: \"kubernetes.io/projected/47025f59-f221-426f-9528-8849a43ce546-kube-api-access-rv8dm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.536157 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.536060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.637422 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.637367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv8dm\" (UniqueName: \"kubernetes.io/projected/47025f59-f221-426f-9528-8849a43ce546-kube-api-access-rv8dm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.637422 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.637427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.637754 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.637457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.637829 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.637812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.637877 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.637849 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.647392 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.647364 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv8dm\" (UniqueName: \"kubernetes.io/projected/47025f59-f221-426f-9528-8849a43ce546-kube-api-access-rv8dm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.735520 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.735409 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:17.867053 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.867021 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559"] Jun 12 18:50:17.870130 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:50:17.870096 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47025f59_f221_426f_9528_8849a43ce546.slice/crio-f6485e0782272512bbbe890afb2f86521b8da2d1f9e3110c149c44d70fb77059 WatchSource:0}: Error finding container f6485e0782272512bbbe890afb2f86521b8da2d1f9e3110c149c44d70fb77059: Status 404 returned error can't find the container with id f6485e0782272512bbbe890afb2f86521b8da2d1f9e3110c149c44d70fb77059 Jun 12 18:50:17.966930 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:17.966896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" event={"ID":"47025f59-f221-426f-9528-8849a43ce546","Type":"ContainerStarted","Data":"f6485e0782272512bbbe890afb2f86521b8da2d1f9e3110c149c44d70fb77059"} Jun 12 18:50:27.005638 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:27.005598 2574 generic.go:356] "Generic (PLEG): container finished" podID="47025f59-f221-426f-9528-8849a43ce546" containerID="c6141afa8b321896e14b95b7ddc31a1edb0312ed276fe84767559113bbaf8ad9" exitCode=0 Jun 12 18:50:27.006004 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:27.005691 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" event={"ID":"47025f59-f221-426f-9528-8849a43ce546","Type":"ContainerDied","Data":"c6141afa8b321896e14b95b7ddc31a1edb0312ed276fe84767559113bbaf8ad9"} Jun 12 18:50:29.017736 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:29.017703 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" event={"ID":"47025f59-f221-426f-9528-8849a43ce546","Type":"ContainerStarted","Data":"8ffa2a1cd8192e46d11f62473ef4477ec868cc6946eef5cde962abc2780da5b1"} Jun 12 18:50:30.024067 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:30.024032 2574 generic.go:356] "Generic (PLEG): container finished" podID="47025f59-f221-426f-9528-8849a43ce546" containerID="8ffa2a1cd8192e46d11f62473ef4477ec868cc6946eef5cde962abc2780da5b1" exitCode=0 Jun 12 18:50:30.024481 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:30.024129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" event={"ID":"47025f59-f221-426f-9528-8849a43ce546","Type":"ContainerDied","Data":"8ffa2a1cd8192e46d11f62473ef4477ec868cc6946eef5cde962abc2780da5b1"} Jun 12 18:50:39.064697 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:39.064662 2574 generic.go:356] "Generic (PLEG): container finished" podID="47025f59-f221-426f-9528-8849a43ce546" containerID="a9b46569f766c0a09bcf7068906e04ad912e96d264b9bd19bc12a50d22489133" exitCode=0 Jun 12 18:50:39.065108 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:39.064735 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" event={"ID":"47025f59-f221-426f-9528-8849a43ce546","Type":"ContainerDied","Data":"a9b46569f766c0a09bcf7068906e04ad912e96d264b9bd19bc12a50d22489133"} Jun 12 18:50:40.244656 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.244620 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:40.328732 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.328644 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-util\") pod \"47025f59-f221-426f-9528-8849a43ce546\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " Jun 12 18:50:40.328732 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.328688 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv8dm\" (UniqueName: \"kubernetes.io/projected/47025f59-f221-426f-9528-8849a43ce546-kube-api-access-rv8dm\") pod \"47025f59-f221-426f-9528-8849a43ce546\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " Jun 12 18:50:40.328916 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.328749 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-bundle\") pod \"47025f59-f221-426f-9528-8849a43ce546\" (UID: \"47025f59-f221-426f-9528-8849a43ce546\") " Jun 12 18:50:40.329449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.329417 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-bundle" (OuterVolumeSpecName: "bundle") pod "47025f59-f221-426f-9528-8849a43ce546" (UID: "47025f59-f221-426f-9528-8849a43ce546"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:50:40.330898 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.330876 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47025f59-f221-426f-9528-8849a43ce546-kube-api-access-rv8dm" (OuterVolumeSpecName: "kube-api-access-rv8dm") pod "47025f59-f221-426f-9528-8849a43ce546" (UID: "47025f59-f221-426f-9528-8849a43ce546"). InnerVolumeSpecName "kube-api-access-rv8dm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:50:40.335188 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.335160 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-util" (OuterVolumeSpecName: "util") pod "47025f59-f221-426f-9528-8849a43ce546" (UID: "47025f59-f221-426f-9528-8849a43ce546"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:50:40.430054 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.430022 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:40.430054 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.430051 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv8dm\" (UniqueName: \"kubernetes.io/projected/47025f59-f221-426f-9528-8849a43ce546-kube-api-access-rv8dm\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:40.430054 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:40.430060 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47025f59-f221-426f-9528-8849a43ce546-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:50:41.074454 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:41.074425 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" Jun 12 18:50:41.074454 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:41.074438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhv559" event={"ID":"47025f59-f221-426f-9528-8849a43ce546","Type":"ContainerDied","Data":"f6485e0782272512bbbe890afb2f86521b8da2d1f9e3110c149c44d70fb77059"} Jun 12 18:50:41.074725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:41.074480 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6485e0782272512bbbe890afb2f86521b8da2d1f9e3110c149c44d70fb77059" Jun 12 18:50:45.493743 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.493705 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb"] Jun 12 18:50:45.494194 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.493997 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47025f59-f221-426f-9528-8849a43ce546" containerName="util" Jun 12 18:50:45.494194 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.494007 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="47025f59-f221-426f-9528-8849a43ce546" containerName="util" Jun 12 18:50:45.494194 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.494018 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47025f59-f221-426f-9528-8849a43ce546" containerName="extract" Jun 12 18:50:45.494194 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.494024 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="47025f59-f221-426f-9528-8849a43ce546" containerName="extract" Jun 12 18:50:45.494194 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.494033 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47025f59-f221-426f-9528-8849a43ce546" containerName="pull" Jun 12 18:50:45.494194 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.494040 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="47025f59-f221-426f-9528-8849a43ce546" containerName="pull" Jun 12 18:50:45.494194 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.494092 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="47025f59-f221-426f-9528-8849a43ce546" containerName="extract" Jun 12 18:50:45.496311 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.496276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.499548 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.499525 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 12 18:50:45.500138 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.500121 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-88kwv\"" Jun 12 18:50:45.500369 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.500354 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:50:45.512320 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.512280 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb"] Jun 12 18:50:45.572717 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.572673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7fb\" (UniqueName: \"kubernetes.io/projected/e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd-kube-api-access-qb7fb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-d8hwb\" (UID: \"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.572896 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.572729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-d8hwb\" (UID: \"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.674000 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.673965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7fb\" (UniqueName: \"kubernetes.io/projected/e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd-kube-api-access-qb7fb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-d8hwb\" (UID: \"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.674115 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.674031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-d8hwb\" (UID: \"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.674395 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.674379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-d8hwb\" (UID: \"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.683207 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.683176 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb7fb\" (UniqueName: \"kubernetes.io/projected/e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd-kube-api-access-qb7fb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-d8hwb\" (UID: \"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.805176 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.805074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" Jun 12 18:50:45.943611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:45.943578 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb"] Jun 12 18:50:45.947484 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:50:45.947454 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c7752b_4691_46f9_8d6e_5a1dfdc16bbd.slice/crio-8034af7c9aac7ef7d40120650d31d4a9f64919f150698773ddaef13948e5ae2f WatchSource:0}: Error finding container 8034af7c9aac7ef7d40120650d31d4a9f64919f150698773ddaef13948e5ae2f: Status 404 returned error can't find the container with id 8034af7c9aac7ef7d40120650d31d4a9f64919f150698773ddaef13948e5ae2f Jun 12 18:50:46.101753 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:46.101672 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" event={"ID":"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd","Type":"ContainerStarted","Data":"8034af7c9aac7ef7d40120650d31d4a9f64919f150698773ddaef13948e5ae2f"} Jun 12 18:50:48.118176 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:48.118141 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" event={"ID":"e8c7752b-4691-46f9-8d6e-5a1dfdc16bbd","Type":"ContainerStarted","Data":"19da0d84feedb6a9e0cdc1fde1d571ecbc9b02552a42536b7d110459e9bcf804"} Jun 12 18:50:48.166422 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:48.166365 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-d8hwb" podStartSLOduration=1.629908596 podStartE2EDuration="3.166348626s" totalImagesPullingTime="1.53644003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:50:48.165585629 +0000 UTC m=+505.331979839" watchObservedRunningTime="2026-06-12 18:50:48.166348626 +0000 UTC m=+505.332742788" Jun 12 18:50:55.626091 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.626045 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4"] Jun 12 18:50:55.629451 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.629429 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:55.632131 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.632108 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 18:50:55.633269 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.633249 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 18:50:55.633387 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.633338 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4sgj5\"" Jun 12 18:50:55.641021 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.640995 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4"] Jun 12 18:50:55.759928 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.759874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c5jw\" (UniqueName: \"kubernetes.io/projected/52d5009a-e920-4a49-8d38-596749e55da2-kube-api-access-2c5jw\") pod \"cert-manager-webhook-7dc76cbb94-6jxj4\" (UID: \"52d5009a-e920-4a49-8d38-596749e55da2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:55.760106 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.760016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52d5009a-e920-4a49-8d38-596749e55da2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6jxj4\" (UID: \"52d5009a-e920-4a49-8d38-596749e55da2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:55.860482 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.860443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52d5009a-e920-4a49-8d38-596749e55da2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6jxj4\" (UID: \"52d5009a-e920-4a49-8d38-596749e55da2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:55.860482 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.860486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c5jw\" (UniqueName: \"kubernetes.io/projected/52d5009a-e920-4a49-8d38-596749e55da2-kube-api-access-2c5jw\") pod \"cert-manager-webhook-7dc76cbb94-6jxj4\" (UID: \"52d5009a-e920-4a49-8d38-596749e55da2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:55.869186 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.869160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52d5009a-e920-4a49-8d38-596749e55da2-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6jxj4\" (UID: \"52d5009a-e920-4a49-8d38-596749e55da2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:55.869360 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.869348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c5jw\" (UniqueName: \"kubernetes.io/projected/52d5009a-e920-4a49-8d38-596749e55da2-kube-api-access-2c5jw\") pod \"cert-manager-webhook-7dc76cbb94-6jxj4\" (UID: \"52d5009a-e920-4a49-8d38-596749e55da2\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:55.939000 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:55.938904 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:56.069206 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:56.069179 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4"] Jun 12 18:50:56.071661 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:50:56.071636 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52d5009a_e920_4a49_8d38_596749e55da2.slice/crio-08df10665c2e33f811c3f0116fe05d3efee94b848f9bfa87fdd85f99372cb0e4 WatchSource:0}: Error finding container 08df10665c2e33f811c3f0116fe05d3efee94b848f9bfa87fdd85f99372cb0e4: Status 404 returned error can't find the container with id 08df10665c2e33f811c3f0116fe05d3efee94b848f9bfa87fdd85f99372cb0e4 Jun 12 18:50:56.153308 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:56.153251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" event={"ID":"52d5009a-e920-4a49-8d38-596749e55da2","Type":"ContainerStarted","Data":"08df10665c2e33f811c3f0116fe05d3efee94b848f9bfa87fdd85f99372cb0e4"} Jun 12 18:50:59.169405 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:59.169366 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" event={"ID":"52d5009a-e920-4a49-8d38-596749e55da2","Type":"ContainerStarted","Data":"6bd22d9303d71547f6f919286ae98d435a8cce94d3909bd7a8b96c2dd4d09014"} Jun 12 18:50:59.169871 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:59.169489 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:50:59.188663 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:50:59.188613 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" podStartSLOduration=1.945453401 podStartE2EDuration="4.188597182s" totalImagesPullingTime="2.243143781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:50:59.187143569 +0000 UTC m=+516.353537733" watchObservedRunningTime="2026-06-12 18:50:59.188597182 +0000 UTC m=+516.354991344" Jun 12 18:51:05.176935 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:05.176900 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6jxj4" Jun 12 18:51:23.683542 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.683502 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv"] Jun 12 18:51:23.689681 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.689659 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.691221 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.691183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.691366 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.691233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkwlh\" (UniqueName: \"kubernetes.io/projected/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-kube-api-access-dkwlh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.691411 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.691371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.692498 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.692475 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 18:51:23.692619 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.692514 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 18:51:23.692619 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.692559 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x9fn8\"" Jun 12 18:51:23.697534 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.697364 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv"] Jun 12 18:51:23.792347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.792303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.792530 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.792361 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkwlh\" (UniqueName: \"kubernetes.io/projected/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-kube-api-access-dkwlh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.792530 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.792458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.792763 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.792741 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.792800 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.792769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.801615 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.801590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkwlh\" (UniqueName: \"kubernetes.io/projected/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-kube-api-access-dkwlh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:23.999946 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:23.999845 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:24.138618 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:24.138582 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv"] Jun 12 18:51:24.141345 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:51:24.141316 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa0e2d1_cb8c_4e69_b806_ecbca4f84275.slice/crio-9974c8d62483f312729f229301a135df23402321df59e8446e32551cae9e60a7 WatchSource:0}: Error finding container 9974c8d62483f312729f229301a135df23402321df59e8446e32551cae9e60a7: Status 404 returned error can't find the container with id 9974c8d62483f312729f229301a135df23402321df59e8446e32551cae9e60a7 Jun 12 18:51:24.278029 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:24.277994 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerID="0527ae212be6f1e97c4f321b9d24502f5921c8a310a5e01e0f146dbc249b39bc" exitCode=0 Jun 12 18:51:24.278210 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:24.278081 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" event={"ID":"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275","Type":"ContainerDied","Data":"0527ae212be6f1e97c4f321b9d24502f5921c8a310a5e01e0f146dbc249b39bc"} Jun 12 18:51:24.278210 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:24.278131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" event={"ID":"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275","Type":"ContainerStarted","Data":"9974c8d62483f312729f229301a135df23402321df59e8446e32551cae9e60a7"} Jun 12 18:51:25.284111 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:25.284078 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerID="ae1d83c685406bf50c879dfa2d6d6b7f3e9a405c8d38da825057aee25bb654af" exitCode=0 Jun 12 18:51:25.284503 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:25.284163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" event={"ID":"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275","Type":"ContainerDied","Data":"ae1d83c685406bf50c879dfa2d6d6b7f3e9a405c8d38da825057aee25bb654af"} Jun 12 18:51:26.291071 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:26.291034 2574 generic.go:356] "Generic (PLEG): container finished" podID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerID="dd5269bbec799c158ac483820f31b505066e0bea4adcc89ab30beb58d24de27b" exitCode=0 Jun 12 18:51:26.291439 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:26.291119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" event={"ID":"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275","Type":"ContainerDied","Data":"dd5269bbec799c158ac483820f31b505066e0bea4adcc89ab30beb58d24de27b"} Jun 12 18:51:27.422543 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.422515 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:27.522986 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.522949 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-bundle\") pod \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " Jun 12 18:51:27.523159 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.523003 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-util\") pod \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " Jun 12 18:51:27.523159 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.523034 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkwlh\" (UniqueName: \"kubernetes.io/projected/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-kube-api-access-dkwlh\") pod \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\" (UID: \"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275\") " Jun 12 18:51:27.523686 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.523659 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-bundle" (OuterVolumeSpecName: "bundle") pod "dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" (UID: "dfa0e2d1-cb8c-4e69-b806-ecbca4f84275"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:51:27.525154 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.525127 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-kube-api-access-dkwlh" (OuterVolumeSpecName: "kube-api-access-dkwlh") pod "dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" (UID: "dfa0e2d1-cb8c-4e69-b806-ecbca4f84275"). InnerVolumeSpecName "kube-api-access-dkwlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:51:27.528895 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.528876 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-util" (OuterVolumeSpecName: "util") pod "dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" (UID: "dfa0e2d1-cb8c-4e69-b806-ecbca4f84275"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:51:27.623720 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.623680 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:51:27.623720 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.623716 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkwlh\" (UniqueName: \"kubernetes.io/projected/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-kube-api-access-dkwlh\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:51:27.623720 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:27.623727 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dfa0e2d1-cb8c-4e69-b806-ecbca4f84275-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:51:28.302599 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:28.302563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" event={"ID":"dfa0e2d1-cb8c-4e69-b806-ecbca4f84275","Type":"ContainerDied","Data":"9974c8d62483f312729f229301a135df23402321df59e8446e32551cae9e60a7"} Jun 12 18:51:28.302599 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:28.302582 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2t6lv" Jun 12 18:51:28.302816 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:28.302613 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9974c8d62483f312729f229301a135df23402321df59e8446e32551cae9e60a7" Jun 12 18:51:38.307206 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307170 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm"] Jun 12 18:51:38.307611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307473 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerName="util" Jun 12 18:51:38.307611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307484 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerName="util" Jun 12 18:51:38.307611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307499 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerName="extract" Jun 12 18:51:38.307611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307505 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerName="extract" Jun 12 18:51:38.307611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307515 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerName="pull" Jun 12 18:51:38.307611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307521 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerName="pull" Jun 12 18:51:38.307611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.307571 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa0e2d1-cb8c-4e69-b806-ecbca4f84275" containerName="extract" Jun 12 18:51:38.309577 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.309560 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.312975 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.312955 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 18:51:38.313160 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.313138 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 18:51:38.313332 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.313279 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m8m9l\"" Jun 12 18:51:38.313540 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.313518 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 18:51:38.313658 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.313641 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 18:51:38.327564 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.327532 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm"] Jun 12 18:51:38.413752 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.413708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41ddf843-f642-4e17-be2e-01351e52e036-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.413752 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.413754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffwhd\" (UniqueName: \"kubernetes.io/projected/41ddf843-f642-4e17-be2e-01351e52e036-kube-api-access-ffwhd\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.414005 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.413779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41ddf843-f642-4e17-be2e-01351e52e036-webhook-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.414005 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.413867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41ddf843-f642-4e17-be2e-01351e52e036-tmp\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.414005 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.413912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41ddf843-f642-4e17-be2e-01351e52e036-manifests\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.514477 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.514436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41ddf843-f642-4e17-be2e-01351e52e036-tmp\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.514477 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.514480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41ddf843-f642-4e17-be2e-01351e52e036-manifests\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.514749 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.514519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41ddf843-f642-4e17-be2e-01351e52e036-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.514749 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.514541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffwhd\" (UniqueName: \"kubernetes.io/projected/41ddf843-f642-4e17-be2e-01351e52e036-kube-api-access-ffwhd\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.514749 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.514565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41ddf843-f642-4e17-be2e-01351e52e036-webhook-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.514936 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.514903 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41ddf843-f642-4e17-be2e-01351e52e036-manifests\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.516923 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.516897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41ddf843-f642-4e17-be2e-01351e52e036-tmp\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.517013 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.516933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41ddf843-f642-4e17-be2e-01351e52e036-webhook-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.517088 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.517067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41ddf843-f642-4e17-be2e-01351e52e036-apiservice-cert\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.529173 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.529147 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffwhd\" (UniqueName: \"kubernetes.io/projected/41ddf843-f642-4e17-be2e-01351e52e036-kube-api-access-ffwhd\") pod \"opendatahub-operator-controller-manager-ffbc465cb-r9msm\" (UID: \"41ddf843-f642-4e17-be2e-01351e52e036\") " pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.620115 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.620082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:38.762111 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:38.762042 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm"] Jun 12 18:51:38.765060 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:51:38.765029 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ddf843_f642_4e17_be2e_01351e52e036.slice/crio-ebd487fc19f472381e669d7537247755efa084e81f8c45cadb0e07118fade73d WatchSource:0}: Error finding container ebd487fc19f472381e669d7537247755efa084e81f8c45cadb0e07118fade73d: Status 404 returned error can't find the container with id ebd487fc19f472381e669d7537247755efa084e81f8c45cadb0e07118fade73d Jun 12 18:51:39.353082 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:39.353040 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" event={"ID":"41ddf843-f642-4e17-be2e-01351e52e036","Type":"ContainerStarted","Data":"ebd487fc19f472381e669d7537247755efa084e81f8c45cadb0e07118fade73d"} Jun 12 18:51:42.368705 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:42.368669 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" event={"ID":"41ddf843-f642-4e17-be2e-01351e52e036","Type":"ContainerStarted","Data":"83c7fca6664c1d7befd73e680353c337df4af8338349d1535bf9993a19a62936"} Jun 12 18:51:43.374395 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:43.374362 2574 generic.go:356] "Generic (PLEG): container finished" podID="41ddf843-f642-4e17-be2e-01351e52e036" containerID="83c7fca6664c1d7befd73e680353c337df4af8338349d1535bf9993a19a62936" exitCode=0 Jun 12 18:51:43.374870 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:43.374400 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" event={"ID":"41ddf843-f642-4e17-be2e-01351e52e036","Type":"ContainerDied","Data":"83c7fca6664c1d7befd73e680353c337df4af8338349d1535bf9993a19a62936"} Jun 12 18:51:44.380950 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:44.380912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" event={"ID":"41ddf843-f642-4e17-be2e-01351e52e036","Type":"ContainerStarted","Data":"9334b081f7f50b9a4d1f03f7aba36f4225d7d8cd4f917bd28f1a9e044c1f2bdf"} Jun 12 18:51:44.381428 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:44.381061 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:44.406497 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:44.406443 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" podStartSLOduration=2.320451196 podStartE2EDuration="6.406426202s" totalImagesPullingTime="3.087960607s" totalInitContainerRuntime="998.014399ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:44.403760549 +0000 UTC m=+561.570154722" watchObservedRunningTime="2026-06-12 18:51:44.406426202 +0000 UTC m=+561.572820363" Jun 12 18:51:55.388056 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:55.388025 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-ffbc465cb-r9msm" Jun 12 18:51:56.137653 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.137613 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk"] Jun 12 18:51:56.142844 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.142823 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.145566 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.145547 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 18:51:56.146725 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.146704 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 18:51:56.146841 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.146767 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 18:51:56.146993 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.146977 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4hhgh\"" Jun 12 18:51:56.147072 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.147048 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 18:51:56.147072 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.147065 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:51:56.153790 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.153765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk"] Jun 12 18:51:56.276633 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.276593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-cert\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.276825 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.276651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-manager-config\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.276825 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.276688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgjz\" (UniqueName: \"kubernetes.io/projected/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-kube-api-access-hkgjz\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.276825 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.276746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-metrics-cert\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.377920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.377880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgjz\" (UniqueName: \"kubernetes.io/projected/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-kube-api-access-hkgjz\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.378122 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.377942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-metrics-cert\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.378122 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.377999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-cert\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.378122 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.378038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-manager-config\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.378736 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.378712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-manager-config\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.380480 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.380460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-metrics-cert\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.380572 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.380498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-cert\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.394585 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.394517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgjz\" (UniqueName: \"kubernetes.io/projected/3c2b3a32-9899-47f2-8fcd-5e21b7feaba4-kube-api-access-hkgjz\") pod \"lws-controller-manager-776cbdb69d-q6tgk\" (UID: \"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4\") " pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.452498 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.452460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:56.599403 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:56.599375 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk"] Jun 12 18:51:56.602090 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:51:56.602063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2b3a32_9899_47f2_8fcd_5e21b7feaba4.slice/crio-5bd307deabe27c093f94e4968d08122953c0c437a0f2326415b4b7ee714a4410 WatchSource:0}: Error finding container 5bd307deabe27c093f94e4968d08122953c0c437a0f2326415b4b7ee714a4410: Status 404 returned error can't find the container with id 5bd307deabe27c093f94e4968d08122953c0c437a0f2326415b4b7ee714a4410 Jun 12 18:51:57.441024 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:57.440979 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" event={"ID":"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4","Type":"ContainerStarted","Data":"5bd307deabe27c093f94e4968d08122953c0c437a0f2326415b4b7ee714a4410"} Jun 12 18:51:58.391527 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.391492 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn"] Jun 12 18:51:58.398360 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.398327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.401827 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.401800 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 18:51:58.402828 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.402800 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 18:51:58.402952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.402839 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 18:51:58.402952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.402848 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6tttj\"" Jun 12 18:51:58.402952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.402839 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 18:51:58.414267 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.414223 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn"] Jun 12 18:51:58.498508 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.498473 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82d4f58a-5084-4ec6-948c-bc154ac897ab-tls-certs\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.498925 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.498542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmjq\" (UniqueName: \"kubernetes.io/projected/82d4f58a-5084-4ec6-948c-bc154ac897ab-kube-api-access-hdmjq\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.498925 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.498671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82d4f58a-5084-4ec6-948c-bc154ac897ab-tmp\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.599707 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.599663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82d4f58a-5084-4ec6-948c-bc154ac897ab-tmp\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.599880 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.599752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82d4f58a-5084-4ec6-948c-bc154ac897ab-tls-certs\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.599880 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.599813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmjq\" (UniqueName: \"kubernetes.io/projected/82d4f58a-5084-4ec6-948c-bc154ac897ab-kube-api-access-hdmjq\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.602566 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.602542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82d4f58a-5084-4ec6-948c-bc154ac897ab-tmp\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.602905 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.602868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82d4f58a-5084-4ec6-948c-bc154ac897ab-tls-certs\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.613716 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.613686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmjq\" (UniqueName: \"kubernetes.io/projected/82d4f58a-5084-4ec6-948c-bc154ac897ab-kube-api-access-hdmjq\") pod \"kube-auth-proxy-5c8b58c9c7-t2ddn\" (UID: \"82d4f58a-5084-4ec6-948c-bc154ac897ab\") " pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:58.710495 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:58.710407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" Jun 12 18:51:59.008122 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:59.008094 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn"] Jun 12 18:51:59.010477 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:51:59.010449 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d4f58a_5084_4ec6_948c_bc154ac897ab.slice/crio-e349cbf2630941b998fe6654dd29a2a0f512dd0a290a27c586efdfe32583bff8 WatchSource:0}: Error finding container e349cbf2630941b998fe6654dd29a2a0f512dd0a290a27c586efdfe32583bff8: Status 404 returned error can't find the container with id e349cbf2630941b998fe6654dd29a2a0f512dd0a290a27c586efdfe32583bff8 Jun 12 18:51:59.453455 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:59.453400 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" event={"ID":"3c2b3a32-9899-47f2-8fcd-5e21b7feaba4","Type":"ContainerStarted","Data":"2649d9e2be7ea4d1d308f1fd8c971b4a329f3f091ccb02b8c517e7406094d701"} Jun 12 18:51:59.453666 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:59.453485 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:51:59.454723 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:59.454691 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" event={"ID":"82d4f58a-5084-4ec6-948c-bc154ac897ab","Type":"ContainerStarted","Data":"e349cbf2630941b998fe6654dd29a2a0f512dd0a290a27c586efdfe32583bff8"} Jun 12 18:51:59.485918 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:51:59.485864 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" podStartSLOduration=1.1676690459999999 podStartE2EDuration="3.485847673s" totalImagesPullingTime="2.318178627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:59.484769091 +0000 UTC m=+576.651163252" watchObservedRunningTime="2026-06-12 18:51:59.485847673 +0000 UTC m=+576.652241834" Jun 12 18:52:02.471342 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:52:02.471278 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" event={"ID":"82d4f58a-5084-4ec6-948c-bc154ac897ab","Type":"ContainerStarted","Data":"d54bdda5650abe403c121e175ab33a8e4336962bb19ad52367a80b49593e39dc"} Jun 12 18:52:02.490402 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:52:02.490352 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c8b58c9c7-t2ddn" podStartSLOduration=1.5513236830000001 podStartE2EDuration="4.490338233s" totalImagesPullingTime="2.93901455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:52:02.489536235 +0000 UTC m=+579.655930399" watchObservedRunningTime="2026-06-12 18:52:02.490338233 +0000 UTC m=+579.656732395" Jun 12 18:52:10.463337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:52:10.463304 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-776cbdb69d-q6tgk" Jun 12 18:53:15.687940 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.687900 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb"] Jun 12 18:53:15.691299 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.691270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.694658 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.694626 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:53:15.694770 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.694693 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5pxfj\"" Jun 12 18:53:15.695617 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.695600 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:53:15.703524 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.703501 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb"] Jun 12 18:53:15.769624 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.769590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.769851 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.769676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvx9x\" (UniqueName: \"kubernetes.io/projected/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-kube-api-access-kvx9x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.769851 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.769727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.871093 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.871056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvx9x\" (UniqueName: \"kubernetes.io/projected/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-kube-api-access-kvx9x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.871327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.871120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.871327 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.871144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.871536 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.871516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.871611 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.871570 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:15.881274 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:15.881244 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvx9x\" (UniqueName: \"kubernetes.io/projected/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-kube-api-access-kvx9x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:16.001249 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:16.001152 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:16.135633 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:16.135607 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb"] Jun 12 18:53:16.138097 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:53:16.138066 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3ac761_4b3e_4d2e_b3e1_5de24136105b.slice/crio-e094baa22d4e187adea5e239aa5eb0a53e12f7f548771f0e2af691fa12b23072 WatchSource:0}: Error finding container e094baa22d4e187adea5e239aa5eb0a53e12f7f548771f0e2af691fa12b23072: Status 404 returned error can't find the container with id e094baa22d4e187adea5e239aa5eb0a53e12f7f548771f0e2af691fa12b23072 Jun 12 18:53:16.803103 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:16.803065 2574 generic.go:356] "Generic (PLEG): container finished" podID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerID="df687d164c3c540883ec6314f2e16c092069a55c251cb5a57fd09db6cc6125f0" exitCode=0 Jun 12 18:53:16.803572 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:16.803135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" event={"ID":"3f3ac761-4b3e-4d2e-b3e1-5de24136105b","Type":"ContainerDied","Data":"df687d164c3c540883ec6314f2e16c092069a55c251cb5a57fd09db6cc6125f0"} Jun 12 18:53:16.803572 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:16.803171 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" event={"ID":"3f3ac761-4b3e-4d2e-b3e1-5de24136105b","Type":"ContainerStarted","Data":"e094baa22d4e187adea5e239aa5eb0a53e12f7f548771f0e2af691fa12b23072"} Jun 12 18:53:16.803645 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:16.803613 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:53:17.810068 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:17.810034 2574 generic.go:356] "Generic (PLEG): container finished" podID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerID="6cd268f3718a3db2855c74c37c22c479f1c2302a23f7fd857dac9b9b56b6e89b" exitCode=0 Jun 12 18:53:17.810489 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:17.810088 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" event={"ID":"3f3ac761-4b3e-4d2e-b3e1-5de24136105b","Type":"ContainerDied","Data":"6cd268f3718a3db2855c74c37c22c479f1c2302a23f7fd857dac9b9b56b6e89b"} Jun 12 18:53:18.816813 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:18.816775 2574 generic.go:356] "Generic (PLEG): container finished" podID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerID="ff596a2cd107036b6a886ac21e53d04529bc810e4bb832553d3d3a5a193d7db6" exitCode=0 Jun 12 18:53:18.817260 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:18.816810 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" event={"ID":"3f3ac761-4b3e-4d2e-b3e1-5de24136105b","Type":"ContainerDied","Data":"ff596a2cd107036b6a886ac21e53d04529bc810e4bb832553d3d3a5a193d7db6"} Jun 12 18:53:19.949626 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:19.949599 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:20.012864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.012828 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvx9x\" (UniqueName: \"kubernetes.io/projected/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-kube-api-access-kvx9x\") pod \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " Jun 12 18:53:20.013029 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.012900 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-bundle\") pod \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " Jun 12 18:53:20.013029 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.012920 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-util\") pod \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\" (UID: \"3f3ac761-4b3e-4d2e-b3e1-5de24136105b\") " Jun 12 18:53:20.013565 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.013542 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-bundle" (OuterVolumeSpecName: "bundle") pod "3f3ac761-4b3e-4d2e-b3e1-5de24136105b" (UID: "3f3ac761-4b3e-4d2e-b3e1-5de24136105b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:20.015172 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.015133 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-kube-api-access-kvx9x" (OuterVolumeSpecName: "kube-api-access-kvx9x") pod "3f3ac761-4b3e-4d2e-b3e1-5de24136105b" (UID: "3f3ac761-4b3e-4d2e-b3e1-5de24136105b"). InnerVolumeSpecName "kube-api-access-kvx9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:53:20.018350 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.018317 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-util" (OuterVolumeSpecName: "util") pod "3f3ac761-4b3e-4d2e-b3e1-5de24136105b" (UID: "3f3ac761-4b3e-4d2e-b3e1-5de24136105b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:53:20.114399 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.114369 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:53:20.114399 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.114397 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-util\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:53:20.114584 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.114408 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvx9x\" (UniqueName: \"kubernetes.io/projected/3f3ac761-4b3e-4d2e-b3e1-5de24136105b-kube-api-access-kvx9x\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:53:20.828146 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.828114 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" Jun 12 18:53:20.828146 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.828135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb" event={"ID":"3f3ac761-4b3e-4d2e-b3e1-5de24136105b","Type":"ContainerDied","Data":"e094baa22d4e187adea5e239aa5eb0a53e12f7f548771f0e2af691fa12b23072"} Jun 12 18:53:20.828379 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:20.828181 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e094baa22d4e187adea5e239aa5eb0a53e12f7f548771f0e2af691fa12b23072" Jun 12 18:53:31.601004 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:31.600962 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fb55f9bb-5n482"] Jun 12 18:53:45.864672 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.864633 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb"] Jun 12 18:53:45.865045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.864953 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerName="extract" Jun 12 18:53:45.865045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.864964 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerName="extract" Jun 12 18:53:45.865045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.864982 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerName="pull" Jun 12 18:53:45.865045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.864987 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerName="pull" Jun 12 18:53:45.865045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.864995 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerName="util" Jun 12 18:53:45.865045 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.865001 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerName="util" Jun 12 18:53:45.865224 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.865060 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3ac761-4b3e-4d2e-b3e1-5de24136105b" containerName="extract" Jun 12 18:53:45.867952 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.867928 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:45.870380 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.870355 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 12 18:53:45.871523 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.871502 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:53:45.871523 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.871519 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 12 18:53:45.871682 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.871547 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5pxfj\"" Jun 12 18:53:45.871682 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.871550 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:53:45.880031 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.880004 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb"] Jun 12 18:53:45.940351 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.940322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:45.940351 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.940354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:45.940544 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:45.940398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmckk\" (UniqueName: \"kubernetes.io/projected/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-kube-api-access-jmckk\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.041433 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.041399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.041433 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.041441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.041694 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.041496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmckk\" (UniqueName: \"kubernetes.io/projected/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-kube-api-access-jmckk\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.041694 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:53:46.041623 2574 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 12 18:53:46.041793 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:53:46.041704 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-plugin-serving-cert podName:bc6d89cc-a7c9-46ad-ade8-be88cfe8832b nodeName:}" failed. No retries permitted until 2026-06-12 18:53:46.541682974 +0000 UTC m=+683.708077121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-nr9hb" (UID: "bc6d89cc-a7c9-46ad-ade8-be88cfe8832b") : secret "plugin-serving-cert" not found Jun 12 18:53:46.042054 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.042031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.070855 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.070824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmckk\" (UniqueName: \"kubernetes.io/projected/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-kube-api-access-jmckk\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.545922 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.545876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.548435 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.548407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bc6d89cc-a7c9-46ad-ade8-be88cfe8832b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nr9hb\" (UID: \"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.777299 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.777258 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" Jun 12 18:53:46.918993 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.918966 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb"] Jun 12 18:53:46.923857 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:53:46.923826 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc6d89cc_a7c9_46ad_ade8_be88cfe8832b.slice/crio-2bfdc47d21685188f8f9cb91ff080965cdc478706d60ac55eb251be255b17b00 WatchSource:0}: Error finding container 2bfdc47d21685188f8f9cb91ff080965cdc478706d60ac55eb251be255b17b00: Status 404 returned error can't find the container with id 2bfdc47d21685188f8f9cb91ff080965cdc478706d60ac55eb251be255b17b00 Jun 12 18:53:46.953253 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:46.953214 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" event={"ID":"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b","Type":"ContainerStarted","Data":"2bfdc47d21685188f8f9cb91ff080965cdc478706d60ac55eb251be255b17b00"} Jun 12 18:53:56.625365 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:53:56.625277 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57fb55f9bb-5n482" podUID="cdefda6e-745a-4b65-9380-020abc77fa9d" containerName="console" containerID="cri-o://73ed6fe5c6dab96d827c99f90ca3008ecaeb63281e0e6b1b66cff76df9e4b62c" gracePeriod=15 Jun 12 18:54:00.817260 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:00.817162 2574 patch_prober.go:28] interesting pod/console-57fb55f9bb-5n482 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 12 18:54:00.817260 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:00.817250 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-57fb55f9bb-5n482" podUID="cdefda6e-745a-4b65-9380-020abc77fa9d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 12 18:54:10.816666 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:10.816625 2574 patch_prober.go:28] interesting pod/console-57fb55f9bb-5n482 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 12 18:54:10.817275 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:10.817239 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-57fb55f9bb-5n482" podUID="cdefda6e-745a-4b65-9380-020abc77fa9d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 12 18:54:11.087420 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.087386 2574 generic.go:356] "Generic (PLEG): container finished" podID="cdefda6e-745a-4b65-9380-020abc77fa9d" containerID="73ed6fe5c6dab96d827c99f90ca3008ecaeb63281e0e6b1b66cff76df9e4b62c" exitCode=0 Jun 12 18:54:11.087531 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.087467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fb55f9bb-5n482" event={"ID":"cdefda6e-745a-4b65-9380-020abc77fa9d","Type":"ContainerDied","Data":"73ed6fe5c6dab96d827c99f90ca3008ecaeb63281e0e6b1b66cff76df9e4b62c"} Jun 12 18:54:11.142783 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.142760 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:54:11.282001 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.281964 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-service-ca\") pod \"cdefda6e-745a-4b65-9380-020abc77fa9d\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " Jun 12 18:54:11.282001 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282005 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-trusted-ca-bundle\") pod \"cdefda6e-745a-4b65-9380-020abc77fa9d\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " Jun 12 18:54:11.282248 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282056 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr8sf\" (UniqueName: \"kubernetes.io/projected/cdefda6e-745a-4b65-9380-020abc77fa9d-kube-api-access-wr8sf\") pod \"cdefda6e-745a-4b65-9380-020abc77fa9d\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " Jun 12 18:54:11.282248 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282079 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-oauth-serving-cert\") pod \"cdefda6e-745a-4b65-9380-020abc77fa9d\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " Jun 12 18:54:11.282248 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282115 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-oauth-config\") pod \"cdefda6e-745a-4b65-9380-020abc77fa9d\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " Jun 12 18:54:11.282248 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282215 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-serving-cert\") pod \"cdefda6e-745a-4b65-9380-020abc77fa9d\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " Jun 12 18:54:11.282490 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282279 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-console-config\") pod \"cdefda6e-745a-4b65-9380-020abc77fa9d\" (UID: \"cdefda6e-745a-4b65-9380-020abc77fa9d\") " Jun 12 18:54:11.282490 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282379 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdefda6e-745a-4b65-9380-020abc77fa9d" (UID: "cdefda6e-745a-4b65-9380-020abc77fa9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:54:11.282598 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282572 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-service-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:11.282658 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282591 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdefda6e-745a-4b65-9380-020abc77fa9d" (UID: "cdefda6e-745a-4b65-9380-020abc77fa9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:54:11.282658 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282605 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cdefda6e-745a-4b65-9380-020abc77fa9d" (UID: "cdefda6e-745a-4b65-9380-020abc77fa9d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:54:11.282849 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.282829 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-console-config" (OuterVolumeSpecName: "console-config") pod "cdefda6e-745a-4b65-9380-020abc77fa9d" (UID: "cdefda6e-745a-4b65-9380-020abc77fa9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:54:11.284331 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.284301 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdefda6e-745a-4b65-9380-020abc77fa9d" (UID: "cdefda6e-745a-4b65-9380-020abc77fa9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:54:11.284331 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.284317 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdefda6e-745a-4b65-9380-020abc77fa9d" (UID: "cdefda6e-745a-4b65-9380-020abc77fa9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:54:11.284461 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.284353 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdefda6e-745a-4b65-9380-020abc77fa9d-kube-api-access-wr8sf" (OuterVolumeSpecName: "kube-api-access-wr8sf") pod "cdefda6e-745a-4b65-9380-020abc77fa9d" (UID: "cdefda6e-745a-4b65-9380-020abc77fa9d"). InnerVolumeSpecName "kube-api-access-wr8sf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:54:11.383099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.383064 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-oauth-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:11.383099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.383093 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdefda6e-745a-4b65-9380-020abc77fa9d-console-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:11.383099 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.383102 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-console-config\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:11.383356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.383110 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-trusted-ca-bundle\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:11.383356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.383119 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr8sf\" (UniqueName: \"kubernetes.io/projected/cdefda6e-745a-4b65-9380-020abc77fa9d-kube-api-access-wr8sf\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:11.383356 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:11.383127 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdefda6e-745a-4b65-9380-020abc77fa9d-oauth-serving-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:12.093508 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:12.093472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" event={"ID":"bc6d89cc-a7c9-46ad-ade8-be88cfe8832b","Type":"ContainerStarted","Data":"9d75dd82951dad04541d30ea871863973aa57b4c1e75e654b4b203f8f071ada5"} Jun 12 18:54:12.094869 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:12.094849 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fb55f9bb-5n482" Jun 12 18:54:12.094978 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:12.094871 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fb55f9bb-5n482" event={"ID":"cdefda6e-745a-4b65-9380-020abc77fa9d","Type":"ContainerDied","Data":"310d7acaaec79fbfbc1b23f8aad8e4afece8146702d2a32022cd5c5ac92e3253"} Jun 12 18:54:12.094978 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:12.094921 2574 scope.go:117] "RemoveContainer" containerID="73ed6fe5c6dab96d827c99f90ca3008ecaeb63281e0e6b1b66cff76df9e4b62c" Jun 12 18:54:12.110515 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:12.110463 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nr9hb" podStartSLOduration=2.9632929 podStartE2EDuration="27.110445097s" totalImagesPullingTime="24.147152197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:12.110073734 +0000 UTC m=+709.276467896" watchObservedRunningTime="2026-06-12 18:54:12.110445097 +0000 UTC m=+709.276839259" Jun 12 18:54:12.135090 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:12.135055 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fb55f9bb-5n482"] Jun 12 18:54:12.143402 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:12.143367 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fb55f9bb-5n482"] Jun 12 18:54:13.260487 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:13.260452 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdefda6e-745a-4b65-9380-020abc77fa9d" path="/var/lib/kubelet/pods/cdefda6e-745a-4b65-9380-020abc77fa9d/volumes" Jun 12 18:54:27.499250 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.499218 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:54:27.499659 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.499540 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdefda6e-745a-4b65-9380-020abc77fa9d" containerName="console" Jun 12 18:54:27.499659 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.499552 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdefda6e-745a-4b65-9380-020abc77fa9d" containerName="console" Jun 12 18:54:27.499659 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.499613 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdefda6e-745a-4b65-9380-020abc77fa9d" containerName="console" Jun 12 18:54:27.557085 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.557047 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:54:27.557085 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.557087 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:54:27.557280 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.557167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.560136 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.560115 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 18:54:27.631920 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.631873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnrv8\" (UniqueName: \"kubernetes.io/projected/7c1f1171-6360-477d-9d37-5cfaf0da32ec-kube-api-access-jnrv8\") pod \"limitador-limitador-54d6d988d5-bs2dl\" (UID: \"7c1f1171-6360-477d-9d37-5cfaf0da32ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.632109 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.631979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7c1f1171-6360-477d-9d37-5cfaf0da32ec-config-file\") pod \"limitador-limitador-54d6d988d5-bs2dl\" (UID: \"7c1f1171-6360-477d-9d37-5cfaf0da32ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.732582 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.732535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnrv8\" (UniqueName: \"kubernetes.io/projected/7c1f1171-6360-477d-9d37-5cfaf0da32ec-kube-api-access-jnrv8\") pod \"limitador-limitador-54d6d988d5-bs2dl\" (UID: \"7c1f1171-6360-477d-9d37-5cfaf0da32ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.732792 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.732640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7c1f1171-6360-477d-9d37-5cfaf0da32ec-config-file\") pod \"limitador-limitador-54d6d988d5-bs2dl\" (UID: \"7c1f1171-6360-477d-9d37-5cfaf0da32ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.733219 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.733199 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7c1f1171-6360-477d-9d37-5cfaf0da32ec-config-file\") pod \"limitador-limitador-54d6d988d5-bs2dl\" (UID: \"7c1f1171-6360-477d-9d37-5cfaf0da32ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.749656 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.749598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnrv8\" (UniqueName: \"kubernetes.io/projected/7c1f1171-6360-477d-9d37-5cfaf0da32ec-kube-api-access-jnrv8\") pod \"limitador-limitador-54d6d988d5-bs2dl\" (UID: \"7c1f1171-6360-477d-9d37-5cfaf0da32ec\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.867062 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.867016 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:27.945256 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.945221 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-swtn5"] Jun 12 18:54:27.950056 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.950031 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swtn5" Jun 12 18:54:27.953212 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.953189 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vznq6\"" Jun 12 18:54:27.961378 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:27.961347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-swtn5"] Jun 12 18:54:28.016735 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.016705 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:54:28.017496 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:54:28.017466 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1f1171_6360_477d_9d37_5cfaf0da32ec.slice/crio-8412429b6c8c534fb7815eb5f874ee34574333498329b75515efea831e78ce5f WatchSource:0}: Error finding container 8412429b6c8c534fb7815eb5f874ee34574333498329b75515efea831e78ce5f: Status 404 returned error can't find the container with id 8412429b6c8c534fb7815eb5f874ee34574333498329b75515efea831e78ce5f Jun 12 18:54:28.034981 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.034939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4hm\" (UniqueName: \"kubernetes.io/projected/0292dd47-ac1f-470d-bbdf-09f5b8e2e265-kube-api-access-4s4hm\") pod \"authorino-58cd955675-swtn5\" (UID: \"0292dd47-ac1f-470d-bbdf-09f5b8e2e265\") " pod="kuadrant-system/authorino-58cd955675-swtn5" Jun 12 18:54:28.135814 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.135768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4hm\" (UniqueName: \"kubernetes.io/projected/0292dd47-ac1f-470d-bbdf-09f5b8e2e265-kube-api-access-4s4hm\") pod \"authorino-58cd955675-swtn5\" (UID: \"0292dd47-ac1f-470d-bbdf-09f5b8e2e265\") " pod="kuadrant-system/authorino-58cd955675-swtn5" Jun 12 18:54:28.144259 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.144223 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4hm\" (UniqueName: \"kubernetes.io/projected/0292dd47-ac1f-470d-bbdf-09f5b8e2e265-kube-api-access-4s4hm\") pod \"authorino-58cd955675-swtn5\" (UID: \"0292dd47-ac1f-470d-bbdf-09f5b8e2e265\") " pod="kuadrant-system/authorino-58cd955675-swtn5" Jun 12 18:54:28.164110 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.164075 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xcdxf"] Jun 12 18:54:28.167662 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.167641 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xcdxf" Jun 12 18:54:28.170538 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.170511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" event={"ID":"7c1f1171-6360-477d-9d37-5cfaf0da32ec","Type":"ContainerStarted","Data":"8412429b6c8c534fb7815eb5f874ee34574333498329b75515efea831e78ce5f"} Jun 12 18:54:28.174210 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.174182 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xcdxf"] Jun 12 18:54:28.236679 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.236643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swtlm\" (UniqueName: \"kubernetes.io/projected/1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab-kube-api-access-swtlm\") pod \"authorino-75d556bd77-xcdxf\" (UID: \"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab\") " pod="kuadrant-system/authorino-75d556bd77-xcdxf" Jun 12 18:54:28.264049 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.264018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swtn5" Jun 12 18:54:28.338075 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.338040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swtlm\" (UniqueName: \"kubernetes.io/projected/1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab-kube-api-access-swtlm\") pod \"authorino-75d556bd77-xcdxf\" (UID: \"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab\") " pod="kuadrant-system/authorino-75d556bd77-xcdxf" Jun 12 18:54:28.347362 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.347331 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swtlm\" (UniqueName: \"kubernetes.io/projected/1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab-kube-api-access-swtlm\") pod \"authorino-75d556bd77-xcdxf\" (UID: \"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab\") " pod="kuadrant-system/authorino-75d556bd77-xcdxf" Jun 12 18:54:28.398347 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.398321 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-swtn5"] Jun 12 18:54:28.400558 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:54:28.400529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0292dd47_ac1f_470d_bbdf_09f5b8e2e265.slice/crio-12f609d7634c52c9298826433df312584489b635e070f3d1d8ba81bb25bcc652 WatchSource:0}: Error finding container 12f609d7634c52c9298826433df312584489b635e070f3d1d8ba81bb25bcc652: Status 404 returned error can't find the container with id 12f609d7634c52c9298826433df312584489b635e070f3d1d8ba81bb25bcc652 Jun 12 18:54:28.477951 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.477922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xcdxf" Jun 12 18:54:28.659963 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:28.659548 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xcdxf"] Jun 12 18:54:28.663273 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:54:28.663237 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a5f02b0_f51e_4885_8a01_fa0d7f7af9ab.slice/crio-4f3518c18b16da88ff1730b46899dd6f8b5aafbb717b46ccb8b369dcba054dab WatchSource:0}: Error finding container 4f3518c18b16da88ff1730b46899dd6f8b5aafbb717b46ccb8b369dcba054dab: Status 404 returned error can't find the container with id 4f3518c18b16da88ff1730b46899dd6f8b5aafbb717b46ccb8b369dcba054dab Jun 12 18:54:29.180983 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:29.180912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swtn5" event={"ID":"0292dd47-ac1f-470d-bbdf-09f5b8e2e265","Type":"ContainerStarted","Data":"12f609d7634c52c9298826433df312584489b635e070f3d1d8ba81bb25bcc652"} Jun 12 18:54:29.182846 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:29.182790 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xcdxf" event={"ID":"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab","Type":"ContainerStarted","Data":"4f3518c18b16da88ff1730b46899dd6f8b5aafbb717b46ccb8b369dcba054dab"} Jun 12 18:54:33.211066 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.210971 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" event={"ID":"7c1f1171-6360-477d-9d37-5cfaf0da32ec","Type":"ContainerStarted","Data":"5ec7e53beb76250e5c454e707abb422a03b666a875204608afa9401180cf6f88"} Jun 12 18:54:33.211066 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.211035 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:54:33.212866 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.212841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swtn5" event={"ID":"0292dd47-ac1f-470d-bbdf-09f5b8e2e265","Type":"ContainerStarted","Data":"c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb"} Jun 12 18:54:33.214208 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.214183 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xcdxf" event={"ID":"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab","Type":"ContainerStarted","Data":"37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31"} Jun 12 18:54:33.234076 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.234023 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" podStartSLOduration=1.270584617 podStartE2EDuration="6.234006111s" totalImagesPullingTime="4.963421494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:33.231336543 +0000 UTC m=+730.397730708" watchObservedRunningTime="2026-06-12 18:54:33.234006111 +0000 UTC m=+730.400400273" Jun 12 18:54:33.248750 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.248698 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-swtn5" podStartSLOduration=1.676771306 podStartE2EDuration="6.24868069s" totalImagesPullingTime="4.571909384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:33.247675869 +0000 UTC m=+730.414070033" watchObservedRunningTime="2026-06-12 18:54:33.24868069 +0000 UTC m=+730.415074852" Jun 12 18:54:33.269473 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.269219 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xcdxf" podStartSLOduration=0.989172387 podStartE2EDuration="5.269192565s" totalImagesPullingTime="4.280020178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:33.268057978 +0000 UTC m=+730.434452141" watchObservedRunningTime="2026-06-12 18:54:33.269192565 +0000 UTC m=+730.435586728" Jun 12 18:54:33.303225 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:33.303184 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-swtn5"] Jun 12 18:54:35.223297 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:35.223252 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-swtn5" podUID="0292dd47-ac1f-470d-bbdf-09f5b8e2e265" containerName="authorino" containerID="cri-o://c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb" gracePeriod=30 Jun 12 18:54:35.466655 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:35.466621 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swtn5" Jun 12 18:54:35.499353 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:35.499248 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s4hm\" (UniqueName: \"kubernetes.io/projected/0292dd47-ac1f-470d-bbdf-09f5b8e2e265-kube-api-access-4s4hm\") pod \"0292dd47-ac1f-470d-bbdf-09f5b8e2e265\" (UID: \"0292dd47-ac1f-470d-bbdf-09f5b8e2e265\") " Jun 12 18:54:35.501379 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:35.501344 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0292dd47-ac1f-470d-bbdf-09f5b8e2e265-kube-api-access-4s4hm" (OuterVolumeSpecName: "kube-api-access-4s4hm") pod "0292dd47-ac1f-470d-bbdf-09f5b8e2e265" (UID: "0292dd47-ac1f-470d-bbdf-09f5b8e2e265"). InnerVolumeSpecName "kube-api-access-4s4hm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:54:35.600894 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:35.600849 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s4hm\" (UniqueName: \"kubernetes.io/projected/0292dd47-ac1f-470d-bbdf-09f5b8e2e265-kube-api-access-4s4hm\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:54:36.229874 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.229839 2574 generic.go:356] "Generic (PLEG): container finished" podID="0292dd47-ac1f-470d-bbdf-09f5b8e2e265" containerID="c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb" exitCode=0 Jun 12 18:54:36.230359 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.229884 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swtn5" event={"ID":"0292dd47-ac1f-470d-bbdf-09f5b8e2e265","Type":"ContainerDied","Data":"c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb"} Jun 12 18:54:36.230359 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.229899 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swtn5" Jun 12 18:54:36.230359 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.229918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swtn5" event={"ID":"0292dd47-ac1f-470d-bbdf-09f5b8e2e265","Type":"ContainerDied","Data":"12f609d7634c52c9298826433df312584489b635e070f3d1d8ba81bb25bcc652"} Jun 12 18:54:36.230359 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.229940 2574 scope.go:117] "RemoveContainer" containerID="c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb" Jun 12 18:54:36.238527 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.238508 2574 scope.go:117] "RemoveContainer" containerID="c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb" Jun 12 18:54:36.238812 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:54:36.238791 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb\": container with ID starting with c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb not found: ID does not exist" containerID="c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb" Jun 12 18:54:36.238881 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.238818 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb"} err="failed to get container status \"c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb\": rpc error: code = NotFound desc = could not find container \"c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb\": container with ID starting with c30e0ae48994b8fee616511984ce99c217a5bf0440dd1b6aff304686190ad8fb not found: ID does not exist" Jun 12 18:54:36.251631 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.251602 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-swtn5"] Jun 12 18:54:36.256010 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:36.255987 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-swtn5"] Jun 12 18:54:37.254813 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:37.254781 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0292dd47-ac1f-470d-bbdf-09f5b8e2e265" path="/var/lib/kubelet/pods/0292dd47-ac1f-470d-bbdf-09f5b8e2e265/volumes" Jun 12 18:54:44.220575 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:54:44.220543 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bs2dl" Jun 12 18:55:23.301128 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.301032 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:55:23.301560 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.301402 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0292dd47-ac1f-470d-bbdf-09f5b8e2e265" containerName="authorino" Jun 12 18:55:23.301560 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.301415 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0292dd47-ac1f-470d-bbdf-09f5b8e2e265" containerName="authorino" Jun 12 18:55:23.301560 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.301473 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0292dd47-ac1f-470d-bbdf-09f5b8e2e265" containerName="authorino" Jun 12 18:55:23.305393 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.305372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:23.308142 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.308117 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 18:55:23.308266 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.308142 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 18:55:23.309098 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.309081 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fxjkr\"" Jun 12 18:55:23.309151 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.309081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 18:55:23.314667 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.314629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:55:23.318233 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.318208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5m62\" (UniqueName: \"kubernetes.io/projected/acbd83b4-c23f-4ef7-8652-ce1e7e944ac5-kube-api-access-w5m62\") pod \"maas-keycloak-0\" (UID: \"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:23.419606 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.419570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5m62\" (UniqueName: \"kubernetes.io/projected/acbd83b4-c23f-4ef7-8652-ce1e7e944ac5-kube-api-access-w5m62\") pod \"maas-keycloak-0\" (UID: \"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:23.430604 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.430575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5m62\" (UniqueName: \"kubernetes.io/projected/acbd83b4-c23f-4ef7-8652-ce1e7e944ac5-kube-api-access-w5m62\") pod \"maas-keycloak-0\" (UID: \"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:23.616795 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.616763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:23.752581 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:23.752419 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:55:23.755519 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:55:23.755491 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbd83b4_c23f_4ef7_8652_ce1e7e944ac5.slice/crio-5d9c303a4b9915aa7d548d8dc38d94e5830076a33bed1011459b554a286ec290 WatchSource:0}: Error finding container 5d9c303a4b9915aa7d548d8dc38d94e5830076a33bed1011459b554a286ec290: Status 404 returned error can't find the container with id 5d9c303a4b9915aa7d548d8dc38d94e5830076a33bed1011459b554a286ec290 Jun 12 18:55:24.457337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:24.457279 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5","Type":"ContainerStarted","Data":"5d9c303a4b9915aa7d548d8dc38d94e5830076a33bed1011459b554a286ec290"} Jun 12 18:55:28.482937 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:28.482902 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5","Type":"ContainerStarted","Data":"340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8"} Jun 12 18:55:28.504406 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:28.504248 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.000971674 podStartE2EDuration="5.504229324s" totalImagesPullingTime="4.50325765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:55:28.503426839 +0000 UTC m=+785.669821020" watchObservedRunningTime="2026-06-12 18:55:28.504229324 +0000 UTC m=+785.670623489" Jun 12 18:55:28.617640 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:28.617598 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:28.619001 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:28.618964 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:29.618275 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:29.618219 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:30.618100 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:30.617982 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:31.618338 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:31.618262 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:32.618172 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:32.618122 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:33.617344 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:33.617306 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:33.618276 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:33.618229 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:34.617855 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:34.617792 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:35.618004 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:35.617947 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:36.617758 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:36.617708 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:37.617817 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:37.617767 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:38.617944 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:38.617901 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:39.617951 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:39.617902 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:40.617795 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:40.617745 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:41.617947 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:41.617885 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 12 18:55:42.748796 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:42.748745 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:42.768680 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:42.768606 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:55:52.755780 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:52.755740 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:55:53.642375 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.642331 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nnphf"] Jun 12 18:55:53.648928 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.648902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nnphf" Jun 12 18:55:53.653703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.653671 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nnphf"] Jun 12 18:55:53.818119 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.818077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlvwj\" (UniqueName: \"kubernetes.io/projected/79eb86ce-26b7-452f-a011-1b757bc4ff89-kube-api-access-mlvwj\") pod \"authorino-5d4b67c446-nnphf\" (UID: \"79eb86ce-26b7-452f-a011-1b757bc4ff89\") " pod="kuadrant-system/authorino-5d4b67c446-nnphf" Jun 12 18:55:53.844470 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.844434 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nnphf"] Jun 12 18:55:53.844731 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:55:53.844709 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mlvwj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-nnphf" podUID="79eb86ce-26b7-452f-a011-1b757bc4ff89" Jun 12 18:55:53.873459 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.873421 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-d48qp"] Jun 12 18:55:53.875548 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.875532 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:53.878478 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.878457 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 12 18:55:53.887845 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.887820 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-d48qp"] Jun 12 18:55:53.913337 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.913233 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-d48qp"] Jun 12 18:55:53.913534 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:55:53.913510 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tcjxq tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-tcjxq tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-d48qp" podUID="7a345c6c-a1ee-46c1-b801-0bf917e37837" Jun 12 18:55:53.919267 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.919240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlvwj\" (UniqueName: \"kubernetes.io/projected/79eb86ce-26b7-452f-a011-1b757bc4ff89-kube-api-access-mlvwj\") pod \"authorino-5d4b67c446-nnphf\" (UID: \"79eb86ce-26b7-452f-a011-1b757bc4ff89\") " pod="kuadrant-system/authorino-5d4b67c446-nnphf" Jun 12 18:55:53.933090 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.933058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlvwj\" (UniqueName: \"kubernetes.io/projected/79eb86ce-26b7-452f-a011-1b757bc4ff89-kube-api-access-mlvwj\") pod \"authorino-5d4b67c446-nnphf\" (UID: \"79eb86ce-26b7-452f-a011-1b757bc4ff89\") " pod="kuadrant-system/authorino-5d4b67c446-nnphf" Jun 12 18:55:53.949072 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.949041 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55d7df9945-jhlcf"] Jun 12 18:55:53.951233 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.951216 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:53.959865 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:53.959840 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55d7df9945-jhlcf"] Jun 12 18:55:54.020511 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.020468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a345c6c-a1ee-46c1-b801-0bf917e37837-tls-cert\") pod \"authorino-76877994-d48qp\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.020700 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.020518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcjxq\" (UniqueName: \"kubernetes.io/projected/7a345c6c-a1ee-46c1-b801-0bf917e37837-kube-api-access-tcjxq\") pod \"authorino-76877994-d48qp\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.121812 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.121774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hrbt\" (UniqueName: \"kubernetes.io/projected/3e630250-f986-4256-921d-da26b2d931b0-kube-api-access-9hrbt\") pod \"authorino-55d7df9945-jhlcf\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:54.122015 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.121898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e630250-f986-4256-921d-da26b2d931b0-tls-cert\") pod \"authorino-55d7df9945-jhlcf\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:54.122015 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.121939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a345c6c-a1ee-46c1-b801-0bf917e37837-tls-cert\") pod \"authorino-76877994-d48qp\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.122015 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.121965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcjxq\" (UniqueName: \"kubernetes.io/projected/7a345c6c-a1ee-46c1-b801-0bf917e37837-kube-api-access-tcjxq\") pod \"authorino-76877994-d48qp\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.124429 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.124405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a345c6c-a1ee-46c1-b801-0bf917e37837-tls-cert\") pod \"authorino-76877994-d48qp\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.129872 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.129853 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcjxq\" (UniqueName: \"kubernetes.io/projected/7a345c6c-a1ee-46c1-b801-0bf917e37837-kube-api-access-tcjxq\") pod \"authorino-76877994-d48qp\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.223107 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.223019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e630250-f986-4256-921d-da26b2d931b0-tls-cert\") pod \"authorino-55d7df9945-jhlcf\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:54.223107 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.223076 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hrbt\" (UniqueName: \"kubernetes.io/projected/3e630250-f986-4256-921d-da26b2d931b0-kube-api-access-9hrbt\") pod \"authorino-55d7df9945-jhlcf\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:54.225482 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.225453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e630250-f986-4256-921d-da26b2d931b0-tls-cert\") pod \"authorino-55d7df9945-jhlcf\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:54.232610 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.232585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hrbt\" (UniqueName: \"kubernetes.io/projected/3e630250-f986-4256-921d-da26b2d931b0-kube-api-access-9hrbt\") pod \"authorino-55d7df9945-jhlcf\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:54.260856 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.260821 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:55:54.406887 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.406855 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55d7df9945-jhlcf"] Jun 12 18:55:54.409491 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:55:54.409462 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e630250_f986_4256_921d_da26b2d931b0.slice/crio-8b7d96af33dc2ce69c9c318f06d5131930097fa626a45aa20676f90bebbef5a6 WatchSource:0}: Error finding container 8b7d96af33dc2ce69c9c318f06d5131930097fa626a45aa20676f90bebbef5a6: Status 404 returned error can't find the container with id 8b7d96af33dc2ce69c9c318f06d5131930097fa626a45aa20676f90bebbef5a6 Jun 12 18:55:54.644140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.644104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55d7df9945-jhlcf" event={"ID":"3e630250-f986-4256-921d-da26b2d931b0","Type":"ContainerStarted","Data":"8b7d96af33dc2ce69c9c318f06d5131930097fa626a45aa20676f90bebbef5a6"} Jun 12 18:55:54.644140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.644131 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nnphf" Jun 12 18:55:54.644140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.644137 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.651103 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.651078 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nnphf" Jun 12 18:55:54.653826 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.653806 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:54.828159 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.828123 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a345c6c-a1ee-46c1-b801-0bf917e37837-tls-cert\") pod \"7a345c6c-a1ee-46c1-b801-0bf917e37837\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " Jun 12 18:55:54.828561 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.828170 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcjxq\" (UniqueName: \"kubernetes.io/projected/7a345c6c-a1ee-46c1-b801-0bf917e37837-kube-api-access-tcjxq\") pod \"7a345c6c-a1ee-46c1-b801-0bf917e37837\" (UID: \"7a345c6c-a1ee-46c1-b801-0bf917e37837\") " Jun 12 18:55:54.828561 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.828245 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlvwj\" (UniqueName: \"kubernetes.io/projected/79eb86ce-26b7-452f-a011-1b757bc4ff89-kube-api-access-mlvwj\") pod \"79eb86ce-26b7-452f-a011-1b757bc4ff89\" (UID: \"79eb86ce-26b7-452f-a011-1b757bc4ff89\") " Jun 12 18:55:54.830302 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.830254 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79eb86ce-26b7-452f-a011-1b757bc4ff89-kube-api-access-mlvwj" (OuterVolumeSpecName: "kube-api-access-mlvwj") pod "79eb86ce-26b7-452f-a011-1b757bc4ff89" (UID: "79eb86ce-26b7-452f-a011-1b757bc4ff89"). InnerVolumeSpecName "kube-api-access-mlvwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:55:54.830422 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.830275 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a345c6c-a1ee-46c1-b801-0bf917e37837-kube-api-access-tcjxq" (OuterVolumeSpecName: "kube-api-access-tcjxq") pod "7a345c6c-a1ee-46c1-b801-0bf917e37837" (UID: "7a345c6c-a1ee-46c1-b801-0bf917e37837"). InnerVolumeSpecName "kube-api-access-tcjxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:55:54.830422 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.830266 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a345c6c-a1ee-46c1-b801-0bf917e37837-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7a345c6c-a1ee-46c1-b801-0bf917e37837" (UID: "7a345c6c-a1ee-46c1-b801-0bf917e37837"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:55:54.929414 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.929388 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlvwj\" (UniqueName: \"kubernetes.io/projected/79eb86ce-26b7-452f-a011-1b757bc4ff89-kube-api-access-mlvwj\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:55:54.929414 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.929413 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a345c6c-a1ee-46c1-b801-0bf917e37837-tls-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:55:54.929577 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:54.929425 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcjxq\" (UniqueName: \"kubernetes.io/projected/7a345c6c-a1ee-46c1-b801-0bf917e37837-kube-api-access-tcjxq\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:55:55.650362 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.650321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55d7df9945-jhlcf" event={"ID":"3e630250-f986-4256-921d-da26b2d931b0","Type":"ContainerStarted","Data":"596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63"} Jun 12 18:55:55.650544 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.650381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d48qp" Jun 12 18:55:55.650544 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.650391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nnphf" Jun 12 18:55:55.669586 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.669539 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55d7df9945-jhlcf" podStartSLOduration=2.208188454 podStartE2EDuration="2.669524308s" totalImagesPullingTime="461.335854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:55:55.668909107 +0000 UTC m=+812.835303269" watchObservedRunningTime="2026-06-12 18:55:55.669524308 +0000 UTC m=+812.835918525" Jun 12 18:55:55.704577 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.704543 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xcdxf"] Jun 12 18:55:55.704850 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.704804 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xcdxf" podUID="1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab" containerName="authorino" containerID="cri-o://37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31" gracePeriod=30 Jun 12 18:55:55.707849 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.707804 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-d48qp"] Jun 12 18:55:55.719058 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.719028 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-d48qp"] Jun 12 18:55:55.741152 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.741124 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nnphf"] Jun 12 18:55:55.745665 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.745632 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nnphf"] Jun 12 18:55:55.969365 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:55.969339 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xcdxf" Jun 12 18:55:56.140679 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.140626 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swtlm\" (UniqueName: \"kubernetes.io/projected/1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab-kube-api-access-swtlm\") pod \"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab\" (UID: \"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab\") " Jun 12 18:55:56.142773 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.142744 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab-kube-api-access-swtlm" (OuterVolumeSpecName: "kube-api-access-swtlm") pod "1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab" (UID: "1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab"). InnerVolumeSpecName "kube-api-access-swtlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:55:56.242198 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.242107 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swtlm\" (UniqueName: \"kubernetes.io/projected/1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab-kube-api-access-swtlm\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:55:56.656844 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.656810 2574 generic.go:356] "Generic (PLEG): container finished" podID="1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab" containerID="37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31" exitCode=0 Jun 12 18:55:56.657028 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.656858 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xcdxf" Jun 12 18:55:56.657028 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.656903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xcdxf" event={"ID":"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab","Type":"ContainerDied","Data":"37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31"} Jun 12 18:55:56.657028 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.656945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xcdxf" event={"ID":"1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab","Type":"ContainerDied","Data":"4f3518c18b16da88ff1730b46899dd6f8b5aafbb717b46ccb8b369dcba054dab"} Jun 12 18:55:56.657028 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.656963 2574 scope.go:117] "RemoveContainer" containerID="37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31" Jun 12 18:55:56.666234 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.666215 2574 scope.go:117] "RemoveContainer" containerID="37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31" Jun 12 18:55:56.666535 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:55:56.666514 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31\": container with ID starting with 37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31 not found: ID does not exist" containerID="37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31" Jun 12 18:55:56.666600 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.666544 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31"} err="failed to get container status \"37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31\": rpc error: code = NotFound desc = could not find container \"37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31\": container with ID starting with 37d53e42c4c2457f921b33fdb635013b70dc60083103642243e89a7cece99c31 not found: ID does not exist" Jun 12 18:55:56.678101 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.678068 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xcdxf"] Jun 12 18:55:56.689476 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:56.685762 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xcdxf"] Jun 12 18:55:57.255064 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:57.255031 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab" path="/var/lib/kubelet/pods/1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab/volumes" Jun 12 18:55:57.255454 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:57.255377 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79eb86ce-26b7-452f-a011-1b757bc4ff89" path="/var/lib/kubelet/pods/79eb86ce-26b7-452f-a011-1b757bc4ff89/volumes" Jun 12 18:55:57.255604 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:55:57.255592 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a345c6c-a1ee-46c1-b801-0bf917e37837" path="/var/lib/kubelet/pods/7a345c6c-a1ee-46c1-b801-0bf917e37837/volumes" Jun 12 18:56:32.548676 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:56:32.548636 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:58:46.274469 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:46.274379 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:58:46.275014 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:46.274571 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" containerID="cri-o://340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8" gracePeriod=30 Jun 12 18:58:48.315453 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.315425 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.402340 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.402268 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5m62\" (UniqueName: \"kubernetes.io/projected/acbd83b4-c23f-4ef7-8652-ce1e7e944ac5-kube-api-access-w5m62\") pod \"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5\" (UID: \"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5\") " Jun 12 18:58:48.404417 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.404386 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acbd83b4-c23f-4ef7-8652-ce1e7e944ac5-kube-api-access-w5m62" (OuterVolumeSpecName: "kube-api-access-w5m62") pod "acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" (UID: "acbd83b4-c23f-4ef7-8652-ce1e7e944ac5"). InnerVolumeSpecName "kube-api-access-w5m62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:58:48.475808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.475704 2574 generic.go:356] "Generic (PLEG): container finished" podID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerID="340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8" exitCode=143 Jun 12 18:58:48.475808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.475746 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.475808 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.475793 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5","Type":"ContainerDied","Data":"340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8"} Jun 12 18:58:48.476068 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.475841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"acbd83b4-c23f-4ef7-8652-ce1e7e944ac5","Type":"ContainerDied","Data":"5d9c303a4b9915aa7d548d8dc38d94e5830076a33bed1011459b554a286ec290"} Jun 12 18:58:48.476068 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.475861 2574 scope.go:117] "RemoveContainer" containerID="340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8" Jun 12 18:58:48.485749 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.485728 2574 scope.go:117] "RemoveContainer" containerID="340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8" Jun 12 18:58:48.486048 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:58:48.486029 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8\": container with ID starting with 340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8 not found: ID does not exist" containerID="340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8" Jun 12 18:58:48.486125 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.486064 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8"} err="failed to get container status \"340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8\": rpc error: code = NotFound desc = could not find container \"340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8\": container with ID starting with 340085480abb57593f16dc9e4d268fae025ef0e462247e18f64e72c7a0cf6dc8 not found: ID does not exist" Jun 12 18:58:48.496864 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.496834 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:58:48.500360 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.500338 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:58:48.502925 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.502908 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5m62\" (UniqueName: \"kubernetes.io/projected/acbd83b4-c23f-4ef7-8652-ce1e7e944ac5-kube-api-access-w5m62\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:58:48.524878 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.524845 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:58:48.525179 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.525167 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" Jun 12 18:58:48.525221 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.525180 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" Jun 12 18:58:48.525221 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.525188 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab" containerName="authorino" Jun 12 18:58:48.525221 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.525193 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab" containerName="authorino" Jun 12 18:58:48.525342 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.525248 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a5f02b0-f51e-4885-8a01-fa0d7f7af9ab" containerName="authorino" Jun 12 18:58:48.525342 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.525259 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" containerName="keycloak" Jun 12 18:58:48.529509 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.529491 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.532047 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.532025 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 18:58:48.532162 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.532092 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fxjkr\"" Jun 12 18:58:48.532162 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.532092 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 12 18:58:48.532281 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.532168 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 18:58:48.532281 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.532202 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 18:58:48.536951 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.536929 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:58:48.603474 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.603434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/91698657-55ee-4f70-8e3c-94d5683d75ec-test-realms\") pod \"maas-keycloak-0\" (UID: \"91698657-55ee-4f70-8e3c-94d5683d75ec\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.603655 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.603517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wqc\" (UniqueName: \"kubernetes.io/projected/91698657-55ee-4f70-8e3c-94d5683d75ec-kube-api-access-k4wqc\") pod \"maas-keycloak-0\" (UID: \"91698657-55ee-4f70-8e3c-94d5683d75ec\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.704329 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.704271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/91698657-55ee-4f70-8e3c-94d5683d75ec-test-realms\") pod \"maas-keycloak-0\" (UID: \"91698657-55ee-4f70-8e3c-94d5683d75ec\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.704506 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.704380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wqc\" (UniqueName: \"kubernetes.io/projected/91698657-55ee-4f70-8e3c-94d5683d75ec-kube-api-access-k4wqc\") pod \"maas-keycloak-0\" (UID: \"91698657-55ee-4f70-8e3c-94d5683d75ec\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.705107 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.705084 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/91698657-55ee-4f70-8e3c-94d5683d75ec-test-realms\") pod \"maas-keycloak-0\" (UID: \"91698657-55ee-4f70-8e3c-94d5683d75ec\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.712997 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.712964 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wqc\" (UniqueName: \"kubernetes.io/projected/91698657-55ee-4f70-8e3c-94d5683d75ec-kube-api-access-k4wqc\") pod \"maas-keycloak-0\" (UID: \"91698657-55ee-4f70-8e3c-94d5683d75ec\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.841017 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.840922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:48.978570 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.978545 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:58:48.981210 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:58:48.981171 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91698657_55ee_4f70_8e3c_94d5683d75ec.slice/crio-40fb031ac9c45a9c751bf1acd1c73acc3d77503525d6e9d8b88074b908d0e7ab WatchSource:0}: Error finding container 40fb031ac9c45a9c751bf1acd1c73acc3d77503525d6e9d8b88074b908d0e7ab: Status 404 returned error can't find the container with id 40fb031ac9c45a9c751bf1acd1c73acc3d77503525d6e9d8b88074b908d0e7ab Jun 12 18:58:48.982677 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:48.982657 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:58:49.255169 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:49.255135 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acbd83b4-c23f-4ef7-8652-ce1e7e944ac5" path="/var/lib/kubelet/pods/acbd83b4-c23f-4ef7-8652-ce1e7e944ac5/volumes" Jun 12 18:58:49.483599 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:49.483569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"91698657-55ee-4f70-8e3c-94d5683d75ec","Type":"ContainerStarted","Data":"11aa3a31476982154e5b1050eb809ae928e90ee0b0fe428dcb40d3e359ff7d20"} Jun 12 18:58:49.483966 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:49.483614 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"91698657-55ee-4f70-8e3c-94d5683d75ec","Type":"ContainerStarted","Data":"40fb031ac9c45a9c751bf1acd1c73acc3d77503525d6e9d8b88074b908d0e7ab"} Jun 12 18:58:49.841367 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:49.841308 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:49.843344 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:49.843277 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:50.841815 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:50.841756 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:51.841499 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:51.841453 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:52.842068 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:52.842018 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:53.841418 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:53.841369 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:54.842319 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:54.842250 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:55.841718 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:55.841655 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:56.841897 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:56.841828 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:57.841930 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:57.841885 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:58.841924 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:58.841880 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:58:58.842217 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:58.842184 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:58:59.841721 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:58:59.841666 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:59:00.841407 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:00.841358 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:59:01.842390 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:01.842338 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 12 18:59:02.975739 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:02.975694 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 18:59:02.995721 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:02.995644 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=14.627431608 podStartE2EDuration="14.995622345s" totalImagesPullingTime="368.190737ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:58:49.499796271 +0000 UTC m=+986.666190434" watchObservedRunningTime="2026-06-12 18:59:02.995622345 +0000 UTC m=+1000.162016508" Jun 12 18:59:02.996819 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:02.996784 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="91698657-55ee-4f70-8e3c-94d5683d75ec" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:59:12.982535 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:12.982500 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:59:23.689673 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.689640 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5595955949-4spgq"] Jun 12 18:59:23.694224 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.694205 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.696642 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.696622 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 12 18:59:23.702007 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.701985 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5595955949-4spgq"] Jun 12 18:59:23.845820 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.845770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvrrb\" (UniqueName: \"kubernetes.io/projected/60044c29-0574-48ec-b3f4-4efd0adc57da-kube-api-access-nvrrb\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.845820 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.845824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60044c29-0574-48ec-b3f4-4efd0adc57da-tls-cert\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.846098 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.845964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60044c29-0574-48ec-b3f4-4efd0adc57da-oidc-ca\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.947249 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.947142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvrrb\" (UniqueName: \"kubernetes.io/projected/60044c29-0574-48ec-b3f4-4efd0adc57da-kube-api-access-nvrrb\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.947249 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.947194 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60044c29-0574-48ec-b3f4-4efd0adc57da-tls-cert\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.947520 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.947258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60044c29-0574-48ec-b3f4-4efd0adc57da-oidc-ca\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.947963 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.947931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60044c29-0574-48ec-b3f4-4efd0adc57da-oidc-ca\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.949706 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.949684 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60044c29-0574-48ec-b3f4-4efd0adc57da-tls-cert\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:23.958034 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:23.958008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvrrb\" (UniqueName: \"kubernetes.io/projected/60044c29-0574-48ec-b3f4-4efd0adc57da-kube-api-access-nvrrb\") pod \"authorino-5595955949-4spgq\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:24.004880 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.004839 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 18:59:24.137091 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.137055 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5595955949-4spgq"] Jun 12 18:59:24.140507 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:59:24.140478 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60044c29_0574_48ec_b3f4_4efd0adc57da.slice/crio-52a2a667e69d39bf3973d5592bf56b895bfb70c77359b75dd9770be5288945ae WatchSource:0}: Error finding container 52a2a667e69d39bf3973d5592bf56b895bfb70c77359b75dd9770be5288945ae: Status 404 returned error can't find the container with id 52a2a667e69d39bf3973d5592bf56b895bfb70c77359b75dd9770be5288945ae Jun 12 18:59:24.682595 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.682556 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595955949-4spgq" event={"ID":"60044c29-0574-48ec-b3f4-4efd0adc57da","Type":"ContainerStarted","Data":"b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74"} Jun 12 18:59:24.682756 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.682609 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595955949-4spgq" event={"ID":"60044c29-0574-48ec-b3f4-4efd0adc57da","Type":"ContainerStarted","Data":"52a2a667e69d39bf3973d5592bf56b895bfb70c77359b75dd9770be5288945ae"} Jun 12 18:59:24.698105 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.698052 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5595955949-4spgq" podStartSLOduration=1.338739952 podStartE2EDuration="1.698030846s" totalImagesPullingTime="359.290894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:59:24.697655249 +0000 UTC m=+1021.864049410" watchObservedRunningTime="2026-06-12 18:59:24.698030846 +0000 UTC m=+1021.864425009" Jun 12 18:59:24.725140 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.725105 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55d7df9945-jhlcf"] Jun 12 18:59:24.725362 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.725314 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-55d7df9945-jhlcf" podUID="3e630250-f986-4256-921d-da26b2d931b0" containerName="authorino" containerID="cri-o://596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63" gracePeriod=30 Jun 12 18:59:24.950275 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.950247 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:59:24.953364 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.953344 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hrbt\" (UniqueName: \"kubernetes.io/projected/3e630250-f986-4256-921d-da26b2d931b0-kube-api-access-9hrbt\") pod \"3e630250-f986-4256-921d-da26b2d931b0\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " Jun 12 18:59:24.953461 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.953392 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e630250-f986-4256-921d-da26b2d931b0-tls-cert\") pod \"3e630250-f986-4256-921d-da26b2d931b0\" (UID: \"3e630250-f986-4256-921d-da26b2d931b0\") " Jun 12 18:59:24.955449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.955423 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e630250-f986-4256-921d-da26b2d931b0-kube-api-access-9hrbt" (OuterVolumeSpecName: "kube-api-access-9hrbt") pod "3e630250-f986-4256-921d-da26b2d931b0" (UID: "3e630250-f986-4256-921d-da26b2d931b0"). InnerVolumeSpecName "kube-api-access-9hrbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:59:24.964053 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:24.964025 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e630250-f986-4256-921d-da26b2d931b0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3e630250-f986-4256-921d-da26b2d931b0" (UID: "3e630250-f986-4256-921d-da26b2d931b0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:59:25.054046 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.053999 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hrbt\" (UniqueName: \"kubernetes.io/projected/3e630250-f986-4256-921d-da26b2d931b0-kube-api-access-9hrbt\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:59:25.054046 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.054033 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e630250-f986-4256-921d-da26b2d931b0-tls-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 18:59:25.688634 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.688595 2574 generic.go:356] "Generic (PLEG): container finished" podID="3e630250-f986-4256-921d-da26b2d931b0" containerID="596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63" exitCode=0 Jun 12 18:59:25.688852 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.688646 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55d7df9945-jhlcf" Jun 12 18:59:25.688852 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.688686 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55d7df9945-jhlcf" event={"ID":"3e630250-f986-4256-921d-da26b2d931b0","Type":"ContainerDied","Data":"596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63"} Jun 12 18:59:25.688852 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.688732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55d7df9945-jhlcf" event={"ID":"3e630250-f986-4256-921d-da26b2d931b0","Type":"ContainerDied","Data":"8b7d96af33dc2ce69c9c318f06d5131930097fa626a45aa20676f90bebbef5a6"} Jun 12 18:59:25.688852 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.688754 2574 scope.go:117] "RemoveContainer" containerID="596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63" Jun 12 18:59:25.697418 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.697387 2574 scope.go:117] "RemoveContainer" containerID="596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63" Jun 12 18:59:25.697655 ip-10-0-129-145 kubenswrapper[2574]: E0612 18:59:25.697635 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63\": container with ID starting with 596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63 not found: ID does not exist" containerID="596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63" Jun 12 18:59:25.697703 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.697664 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63"} err="failed to get container status \"596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63\": rpc error: code = NotFound desc = could not find container \"596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63\": container with ID starting with 596621890acf21791c59ff18d48def9c3eb33174fca7e0947482ac0d0459ab63 not found: ID does not exist" Jun 12 18:59:25.735621 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.735591 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55d7df9945-jhlcf"] Jun 12 18:59:25.740236 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:25.740207 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55d7df9945-jhlcf"] Jun 12 18:59:27.255066 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:27.255023 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e630250-f986-4256-921d-da26b2d931b0" path="/var/lib/kubelet/pods/3e630250-f986-4256-921d-da26b2d931b0/volumes" Jun 12 18:59:42.007193 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:42.007150 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:59:47.129843 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.129798 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt"] Jun 12 18:59:47.130228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.130163 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e630250-f986-4256-921d-da26b2d931b0" containerName="authorino" Jun 12 18:59:47.130228 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.130175 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e630250-f986-4256-921d-da26b2d931b0" containerName="authorino" Jun 12 18:59:47.130317 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.130245 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e630250-f986-4256-921d-da26b2d931b0" containerName="authorino" Jun 12 18:59:47.133477 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.133459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.136742 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.136716 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 18:59:47.137552 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.137532 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9q6dj\"" Jun 12 18:59:47.137675 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.137576 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 18:59:47.137675 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.137536 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 12 18:59:47.151464 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.151434 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt"] Jun 12 18:59:47.240231 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.240190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.240411 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.240239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.240411 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.240261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f58t6\" (UniqueName: \"kubernetes.io/projected/268507fe-e1fe-4a4e-b488-71c75e3ac93c-kube-api-access-f58t6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.240411 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.240337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.240411 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.240352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.240550 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.240441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/268507fe-e1fe-4a4e-b488-71c75e3ac93c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.341705 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.341652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.341878 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.341742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/268507fe-e1fe-4a4e-b488-71c75e3ac93c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.341878 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.341780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.341878 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.341801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.341878 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.341826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f58t6\" (UniqueName: \"kubernetes.io/projected/268507fe-e1fe-4a4e-b488-71c75e3ac93c-kube-api-access-f58t6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.341878 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.341867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.342250 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.342227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.342351 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.342276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.342351 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.342327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.344104 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.344077 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/268507fe-e1fe-4a4e-b488-71c75e3ac93c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.344208 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.344189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/268507fe-e1fe-4a4e-b488-71c75e3ac93c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.349773 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.349751 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f58t6\" (UniqueName: \"kubernetes.io/projected/268507fe-e1fe-4a4e-b488-71c75e3ac93c-kube-api-access-f58t6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7z5jt\" (UID: \"268507fe-e1fe-4a4e-b488-71c75e3ac93c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.443992 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.443878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:47.579832 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.579663 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt"] Jun 12 18:59:47.584541 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:59:47.584506 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268507fe_e1fe_4a4e_b488_71c75e3ac93c.slice/crio-e6e4aab201154351da0971fa651ca3cb184626274d5381ca05d5c64f3c4f5804 WatchSource:0}: Error finding container e6e4aab201154351da0971fa651ca3cb184626274d5381ca05d5c64f3c4f5804: Status 404 returned error can't find the container with id e6e4aab201154351da0971fa651ca3cb184626274d5381ca05d5c64f3c4f5804 Jun 12 18:59:47.599672 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.599637 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:59:47.798119 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:47.798024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" event={"ID":"268507fe-e1fe-4a4e-b488-71c75e3ac93c","Type":"ContainerStarted","Data":"e6e4aab201154351da0971fa651ca3cb184626274d5381ca05d5c64f3c4f5804"} Jun 12 18:59:50.816510 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:50.816392 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" event={"ID":"268507fe-e1fe-4a4e-b488-71c75e3ac93c","Type":"ContainerStarted","Data":"8793f0fee88ef96681f3d624806768e670bc8de236347ed493a4caa2f44ac60c"} Jun 12 18:59:52.827775 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:52.827735 2574 generic.go:356] "Generic (PLEG): container finished" podID="268507fe-e1fe-4a4e-b488-71c75e3ac93c" containerID="8793f0fee88ef96681f3d624806768e670bc8de236347ed493a4caa2f44ac60c" exitCode=0 Jun 12 18:59:52.828212 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:52.827810 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" event={"ID":"268507fe-e1fe-4a4e-b488-71c75e3ac93c","Type":"ContainerDied","Data":"8793f0fee88ef96681f3d624806768e670bc8de236347ed493a4caa2f44ac60c"} Jun 12 18:59:54.841957 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:54.841923 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" event={"ID":"268507fe-e1fe-4a4e-b488-71c75e3ac93c","Type":"ContainerStarted","Data":"d80a06517d41ebaf49385627ca515e0edaeae9cfc4db665d42e00ded1624b5dc"} Jun 12 18:59:54.861565 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:54.861511 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" podStartSLOduration=2.6289786790000003 podStartE2EDuration="7.861495647s" totalImagesPullingTime="3.913315908s" totalInitContainerRuntime="1.31920106s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:59:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:59:54.859627499 +0000 UTC m=+1052.026021661" watchObservedRunningTime="2026-06-12 18:59:54.861495647 +0000 UTC m=+1052.027889786" Jun 12 18:59:57.444792 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:57.444742 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:57.445186 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:57.444830 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:57.457449 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:57.457417 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:57.867773 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:57.867738 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7z5jt" Jun 12 18:59:59.131881 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.131841 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452"] Jun 12 18:59:59.137242 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.137214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.139941 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.139915 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 12 18:59:59.146147 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.146118 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452"] Jun 12 18:59:59.253153 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.253121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.253355 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.253182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24dab97e-76da-4b4a-81be-4051bf3c232d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.253355 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.253206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.253355 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.253243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.253355 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.253295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr48l\" (UniqueName: \"kubernetes.io/projected/24dab97e-76da-4b4a-81be-4051bf3c232d-kube-api-access-mr48l\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.253355 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.253338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.354465 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.354423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.354664 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.354586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24dab97e-76da-4b4a-81be-4051bf3c232d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.354664 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.354617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.354807 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.354776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.354879 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.354820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr48l\" (UniqueName: \"kubernetes.io/projected/24dab97e-76da-4b4a-81be-4051bf3c232d-kube-api-access-mr48l\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.354879 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.354871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.355018 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.354997 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.355145 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.355085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.355241 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.355220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.357385 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.357366 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24dab97e-76da-4b4a-81be-4051bf3c232d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.357575 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.357559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24dab97e-76da-4b4a-81be-4051bf3c232d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.364776 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.364753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr48l\" (UniqueName: \"kubernetes.io/projected/24dab97e-76da-4b4a-81be-4051bf3c232d-kube-api-access-mr48l\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452\" (UID: \"24dab97e-76da-4b4a-81be-4051bf3c232d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.449459 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.449351 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 18:59:59.586385 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.586356 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452"] Jun 12 18:59:59.588475 ip-10-0-129-145 kubenswrapper[2574]: W0612 18:59:59.588441 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24dab97e_76da_4b4a_81be_4051bf3c232d.slice/crio-a43efc07bc1bb83c298a8a07875c2381f80f87a58bb9f53757c8854b07d79227 WatchSource:0}: Error finding container a43efc07bc1bb83c298a8a07875c2381f80f87a58bb9f53757c8854b07d79227: Status 404 returned error can't find the container with id a43efc07bc1bb83c298a8a07875c2381f80f87a58bb9f53757c8854b07d79227 Jun 12 18:59:59.696350 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.696311 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 18:59:59.868341 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.868302 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" event={"ID":"24dab97e-76da-4b4a-81be-4051bf3c232d","Type":"ContainerStarted","Data":"d4ee048345b693766ec22703f6301ccf536093abcf28a8f0c3cbfbea1c329d8e"} Jun 12 18:59:59.868526 ip-10-0-129-145 kubenswrapper[2574]: I0612 18:59:59.868361 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" event={"ID":"24dab97e-76da-4b4a-81be-4051bf3c232d","Type":"ContainerStarted","Data":"a43efc07bc1bb83c298a8a07875c2381f80f87a58bb9f53757c8854b07d79227"} Jun 12 19:00:05.097331 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:05.097220 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:00:17.593074 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:17.593036 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:00:23.255670 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.255645 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr"] Jun 12 19:00:23.273486 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.273454 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr"] Jun 12 19:00:23.273643 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.273559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.276182 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.276154 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 12 19:00:23.355802 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.355768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.355802 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.355808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.356043 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.355832 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.356043 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.355864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beb5c9a2-62ed-48ee-a3a9-ced77a224271-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.356043 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.355887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwzr\" (UniqueName: \"kubernetes.io/projected/beb5c9a2-62ed-48ee-a3a9-ced77a224271-kube-api-access-qxwzr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.356043 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.355952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457403 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457403 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457651 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beb5c9a2-62ed-48ee-a3a9-ced77a224271-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457651 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwzr\" (UniqueName: \"kubernetes.io/projected/beb5c9a2-62ed-48ee-a3a9-ced77a224271-kube-api-access-qxwzr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457651 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457651 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457854 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457810 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457922 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457852 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.457975 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.457913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.459686 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.459666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beb5c9a2-62ed-48ee-a3a9-ced77a224271-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.460060 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.460039 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beb5c9a2-62ed-48ee-a3a9-ced77a224271-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.464952 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.464930 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwzr\" (UniqueName: \"kubernetes.io/projected/beb5c9a2-62ed-48ee-a3a9-ced77a224271-kube-api-access-qxwzr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-j5cwr\" (UID: \"beb5c9a2-62ed-48ee-a3a9-ced77a224271\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.583986 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.583896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:23.719209 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.719185 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr"] Jun 12 19:00:23.720686 ip-10-0-129-145 kubenswrapper[2574]: W0612 19:00:23.720659 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb5c9a2_62ed_48ee_a3a9_ced77a224271.slice/crio-4690c535b13364f2cd3460cf500dfe706fe4ae7177687749e8622e1816c56618 WatchSource:0}: Error finding container 4690c535b13364f2cd3460cf500dfe706fe4ae7177687749e8622e1816c56618: Status 404 returned error can't find the container with id 4690c535b13364f2cd3460cf500dfe706fe4ae7177687749e8622e1816c56618 Jun 12 19:00:23.989600 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.989555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" event={"ID":"beb5c9a2-62ed-48ee-a3a9-ced77a224271","Type":"ContainerStarted","Data":"1e183e9a863b51bbf957800f65aa959320a0ba10216400104f5014536cc1bd11"} Jun 12 19:00:23.989600 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:23.989610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" event={"ID":"beb5c9a2-62ed-48ee-a3a9-ced77a224271","Type":"ContainerStarted","Data":"4690c535b13364f2cd3460cf500dfe706fe4ae7177687749e8622e1816c56618"} Jun 12 19:00:24.496704 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:24.496667 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:00:26.000018 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:25.999984 2574 generic.go:356] "Generic (PLEG): container finished" podID="beb5c9a2-62ed-48ee-a3a9-ced77a224271" containerID="1e183e9a863b51bbf957800f65aa959320a0ba10216400104f5014536cc1bd11" exitCode=0 Jun 12 19:00:26.000538 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:26.000060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" event={"ID":"beb5c9a2-62ed-48ee-a3a9-ced77a224271","Type":"ContainerDied","Data":"1e183e9a863b51bbf957800f65aa959320a0ba10216400104f5014536cc1bd11"} Jun 12 19:00:27.007556 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:27.007522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" event={"ID":"beb5c9a2-62ed-48ee-a3a9-ced77a224271","Type":"ContainerStarted","Data":"9a7a4119614e3723cbe6ed078a31b42b8c362f549ec7b8d6e4cb380a9fae594d"} Jun 12 19:00:27.028259 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:27.028197 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" podStartSLOduration=1.827018528 podStartE2EDuration="4.028179907s" totalImagesPullingTime="886.143177ms" totalInitContainerRuntime="1.315018202s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:00:27.025991594 +0000 UTC m=+1084.192385756" watchObservedRunningTime="2026-06-12 19:00:27.028179907 +0000 UTC m=+1084.194574068" Jun 12 19:00:33.584365 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:33.584326 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:33.584792 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:33.584400 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:33.596999 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:33.596975 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:00:34.055106 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:00:34.055070 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-j5cwr" Jun 12 19:01:15.244662 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:15.244552 2574 generic.go:356] "Generic (PLEG): container finished" podID="24dab97e-76da-4b4a-81be-4051bf3c232d" containerID="d4ee048345b693766ec22703f6301ccf536093abcf28a8f0c3cbfbea1c329d8e" exitCode=0 Jun 12 19:01:15.244662 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:15.244625 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" event={"ID":"24dab97e-76da-4b4a-81be-4051bf3c232d","Type":"ContainerDied","Data":"d4ee048345b693766ec22703f6301ccf536093abcf28a8f0c3cbfbea1c329d8e"} Jun 12 19:01:16.252013 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:16.251976 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" event={"ID":"24dab97e-76da-4b4a-81be-4051bf3c232d","Type":"ContainerStarted","Data":"233194afe9563a5ebc0a06dfa2139b5f927d43fbe719ad19590072744245e956"} Jun 12 19:01:16.271547 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:16.271494 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" podStartSLOduration=1.754717831 podStartE2EDuration="1m17.27147957s" totalImagesPullingTime="251.012312ms" totalInitContainerRuntime="1m15.265749427s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:01:16.269919628 +0000 UTC m=+1133.436313803" watchObservedRunningTime="2026-06-12 19:01:16.27147957 +0000 UTC m=+1133.437873733" Jun 12 19:01:19.450177 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:19.450135 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 19:01:19.450744 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:19.450205 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 19:01:19.462943 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:19.462907 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 19:01:20.282932 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:01:20.282904 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452" Jun 12 19:02:06.299786 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.299745 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54f8576bbd-wmvcp"] Jun 12 19:02:06.303181 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.303160 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.310985 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.310962 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f8576bbd-wmvcp"] Jun 12 19:02:06.379665 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.379620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2167b0d4-be6e-49df-8041-b107c6b05f1d-oidc-ca\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.379665 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.379669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxc9\" (UniqueName: \"kubernetes.io/projected/2167b0d4-be6e-49df-8041-b107c6b05f1d-kube-api-access-6fxc9\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.379903 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.379687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2167b0d4-be6e-49df-8041-b107c6b05f1d-tls-cert\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.480380 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.480328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2167b0d4-be6e-49df-8041-b107c6b05f1d-oidc-ca\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.480556 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.480388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxc9\" (UniqueName: \"kubernetes.io/projected/2167b0d4-be6e-49df-8041-b107c6b05f1d-kube-api-access-6fxc9\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.480556 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.480420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2167b0d4-be6e-49df-8041-b107c6b05f1d-tls-cert\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.481042 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.481021 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2167b0d4-be6e-49df-8041-b107c6b05f1d-oidc-ca\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.483093 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.483067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2167b0d4-be6e-49df-8041-b107c6b05f1d-tls-cert\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.488763 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.488741 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxc9\" (UniqueName: \"kubernetes.io/projected/2167b0d4-be6e-49df-8041-b107c6b05f1d-kube-api-access-6fxc9\") pod \"authorino-54f8576bbd-wmvcp\" (UID: \"2167b0d4-be6e-49df-8041-b107c6b05f1d\") " pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.613298 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.613257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8576bbd-wmvcp" Jun 12 19:02:06.750236 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:06.750205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f8576bbd-wmvcp"] Jun 12 19:02:06.752445 ip-10-0-129-145 kubenswrapper[2574]: W0612 19:02:06.752415 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2167b0d4_be6e_49df_8041_b107c6b05f1d.slice/crio-5e412faafd66ca0a68c93c0a257f462bfaf03fd071cb4be7298410eab97bd1cb WatchSource:0}: Error finding container 5e412faafd66ca0a68c93c0a257f462bfaf03fd071cb4be7298410eab97bd1cb: Status 404 returned error can't find the container with id 5e412faafd66ca0a68c93c0a257f462bfaf03fd071cb4be7298410eab97bd1cb Jun 12 19:02:07.508305 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.508244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8576bbd-wmvcp" event={"ID":"2167b0d4-be6e-49df-8041-b107c6b05f1d","Type":"ContainerStarted","Data":"c03b507c7ed6ebe6a8615c9132b52ac0d121402f24fec2eea1d8f8cafd5d7e40"} Jun 12 19:02:07.508667 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.508318 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8576bbd-wmvcp" event={"ID":"2167b0d4-be6e-49df-8041-b107c6b05f1d","Type":"ContainerStarted","Data":"5e412faafd66ca0a68c93c0a257f462bfaf03fd071cb4be7298410eab97bd1cb"} Jun 12 19:02:07.524622 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.524573 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54f8576bbd-wmvcp" podStartSLOduration=0.923916189 podStartE2EDuration="1.524557424s" totalImagesPullingTime="600.641235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:02:07.523065456 +0000 UTC m=+1184.689459619" watchObservedRunningTime="2026-06-12 19:02:07.524557424 +0000 UTC m=+1184.690951586" Jun 12 19:02:07.548217 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.548180 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5595955949-4spgq"] Jun 12 19:02:07.548448 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.548421 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5595955949-4spgq" podUID="60044c29-0574-48ec-b3f4-4efd0adc57da" containerName="authorino" containerID="cri-o://b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74" gracePeriod=30 Jun 12 19:02:07.818649 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.818607 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 19:02:07.892606 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.892565 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvrrb\" (UniqueName: \"kubernetes.io/projected/60044c29-0574-48ec-b3f4-4efd0adc57da-kube-api-access-nvrrb\") pod \"60044c29-0574-48ec-b3f4-4efd0adc57da\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " Jun 12 19:02:07.892802 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.892631 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60044c29-0574-48ec-b3f4-4efd0adc57da-tls-cert\") pod \"60044c29-0574-48ec-b3f4-4efd0adc57da\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " Jun 12 19:02:07.892802 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.892690 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60044c29-0574-48ec-b3f4-4efd0adc57da-oidc-ca\") pod \"60044c29-0574-48ec-b3f4-4efd0adc57da\" (UID: \"60044c29-0574-48ec-b3f4-4efd0adc57da\") " Jun 12 19:02:07.894797 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.894749 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60044c29-0574-48ec-b3f4-4efd0adc57da-kube-api-access-nvrrb" (OuterVolumeSpecName: "kube-api-access-nvrrb") pod "60044c29-0574-48ec-b3f4-4efd0adc57da" (UID: "60044c29-0574-48ec-b3f4-4efd0adc57da"). InnerVolumeSpecName "kube-api-access-nvrrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:02:07.897615 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.897582 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60044c29-0574-48ec-b3f4-4efd0adc57da-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "60044c29-0574-48ec-b3f4-4efd0adc57da" (UID: "60044c29-0574-48ec-b3f4-4efd0adc57da"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:02:07.905169 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.905136 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60044c29-0574-48ec-b3f4-4efd0adc57da-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "60044c29-0574-48ec-b3f4-4efd0adc57da" (UID: "60044c29-0574-48ec-b3f4-4efd0adc57da"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:02:07.993903 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.993819 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvrrb\" (UniqueName: \"kubernetes.io/projected/60044c29-0574-48ec-b3f4-4efd0adc57da-kube-api-access-nvrrb\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 19:02:07.993903 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.993851 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60044c29-0574-48ec-b3f4-4efd0adc57da-tls-cert\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 19:02:07.993903 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:07.993861 2574 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/60044c29-0574-48ec-b3f4-4efd0adc57da-oidc-ca\") on node \"ip-10-0-129-145.ec2.internal\" DevicePath \"\"" Jun 12 19:02:08.515821 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.515779 2574 generic.go:356] "Generic (PLEG): container finished" podID="60044c29-0574-48ec-b3f4-4efd0adc57da" containerID="b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74" exitCode=0 Jun 12 19:02:08.516320 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.515825 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5595955949-4spgq" Jun 12 19:02:08.516320 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.515859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595955949-4spgq" event={"ID":"60044c29-0574-48ec-b3f4-4efd0adc57da","Type":"ContainerDied","Data":"b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74"} Jun 12 19:02:08.516320 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.515908 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5595955949-4spgq" event={"ID":"60044c29-0574-48ec-b3f4-4efd0adc57da","Type":"ContainerDied","Data":"52a2a667e69d39bf3973d5592bf56b895bfb70c77359b75dd9770be5288945ae"} Jun 12 19:02:08.516320 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.515933 2574 scope.go:117] "RemoveContainer" containerID="b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74" Jun 12 19:02:08.526175 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.526152 2574 scope.go:117] "RemoveContainer" containerID="b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74" Jun 12 19:02:08.526516 ip-10-0-129-145 kubenswrapper[2574]: E0612 19:02:08.526497 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74\": container with ID starting with b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74 not found: ID does not exist" containerID="b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74" Jun 12 19:02:08.526596 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.526524 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74"} err="failed to get container status \"b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74\": rpc error: code = NotFound desc = could not find container \"b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74\": container with ID starting with b48fa0a7f24b2239729f7d00a4ab2cbf4cf719eba71db6a5faded606a1a2ce74 not found: ID does not exist" Jun 12 19:02:08.552578 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.552161 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5595955949-4spgq"] Jun 12 19:02:08.552578 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:08.552229 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5595955949-4spgq"] Jun 12 19:02:09.256485 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:09.256443 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60044c29-0574-48ec-b3f4-4efd0adc57da" path="/var/lib/kubelet/pods/60044c29-0574-48ec-b3f4-4efd0adc57da/volumes" Jun 12 19:02:38.000615 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:38.000574 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:02:47.794737 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:47.794695 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:02:57.191961 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:02:57.191914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:03:08.002907 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:03:08.002801 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:03:16.495700 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:03:16.495654 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:03:27.002368 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:03:27.002331 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:04:39.801445 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:04:39.801354 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:04:55.896356 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:04:55.896317 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:05:33.995629 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:05:33.995584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:05:50.790429 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:05:50.790391 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:06:05.492051 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:06:05.491962 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:06:20.490902 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:06:20.490862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:06:24.199263 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:06:24.199221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:07:20.897408 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:07:20.897364 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:07:29.792241 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:07:29.792200 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:07:46.598689 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:07:46.598593 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:07:54.994814 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:07:54.994776 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:08:12.690808 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:08:12.690763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:08:21.005676 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:08:21.005629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:08:53.421805 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:08:53.421770 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:09:01.496732 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:09:01.496640 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:09:04.799994 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:09:04.799955 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:09:11.104301 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:09:11.104257 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:09:18.725720 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:09:18.725680 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:09:27.104796 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:09:27.104758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:09:52.702112 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:09:52.702074 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:10:04.606645 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:10:04.606599 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:10:33.426173 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:10:33.426086 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:10:35.997155 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:10:35.997116 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:10:52.703438 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:10:52.703396 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:11:00.504562 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:11:00.504518 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:11:19.900615 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:11:19.900571 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:11:24.794585 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:11:24.794548 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:11:28.707179 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:11:28.707140 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:11:37.035009 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:11:37.034957 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:11:45.920519 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:11:45.920481 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:11:54.905225 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:11:54.905188 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:12:03.594868 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:12:03.594772 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:12:12.395955 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:12:12.395906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:12:20.594564 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:12:20.594529 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:12:29.298374 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:12:29.298334 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:12:37.495879 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:12:37.495840 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:15:00.721657 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:15:00.721567 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:15:05.398726 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:15:05.398683 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:15:33.021629 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:15:33.021584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:15:36.606405 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:15:36.606365 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:15:46.903977 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:15:46.903940 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:15:56.593854 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:15:56.593812 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:16:06.109455 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:16:06.109414 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:16:14.990471 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:16:14.990431 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:16:25.499892 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:16:25.499854 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:16:35.197593 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:16:35.197503 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:16:44.796667 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:16:44.796627 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:16:54.096925 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:16:54.096884 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:17:04.012122 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:17:04.012078 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:17:08.995651 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:17:08.995613 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:17:38.310695 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:17:38.310655 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:18:22.591950 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:18:22.591861 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:18:30.090361 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:18:30.090319 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:18:39.701427 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:18:39.701389 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:18:49.596007 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:18:49.595969 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:18:59.190399 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:18:59.190360 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:19:10.594811 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:19:10.594771 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:19:20.596341 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:19:20.596300 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:19:25.601704 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:19:25.601661 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:19:35.308347 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:19:35.308255 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:19:42.490651 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:19:42.490605 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:19:50.597174 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:19:50.597133 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:20:01.195447 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:20:01.195409 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:20:20.399105 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:20:20.399062 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:20:27.192830 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:20:27.192792 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:20:37.797611 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:20:37.797568 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:20:45.035411 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:20:45.035373 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:21:03.102308 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:21:03.102201 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:21:10.297015 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:21:10.296972 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:21:20.098133 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:21:20.098093 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:21:27.502064 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:21:27.502024 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:21:37.511660 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:21:37.511620 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:21:44.801357 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:21:44.801323 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:21:55.097515 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:21:55.097472 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:22:06.998967 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:22:06.998925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:22:17.404336 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:22:17.404294 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:22:29.495184 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:22:29.495137 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:22:39.696635 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:22:39.696541 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:22:43.726459 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:22:43.726419 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:22:53.242275 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:22:53.242234 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:22:58.589633 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:22:58.589593 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:23:13.222588 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:23:13.222552 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:23:21.999343 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:23:21.999302 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:23:31.311263 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:23:31.311221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:23:36.906171 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:23:36.906129 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:23:59.110437 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:23:59.110393 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:24:11.704341 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:11.704243 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bs2dl"] Jun 12 19:24:45.080688 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:45.080647 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f8576bbd-wmvcp_2167b0d4-be6e-49df-8041-b107c6b05f1d/authorino/0.log" Jun 12 19:24:51.286919 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:51.286887 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-r9msm_41ddf843-f642-4e17-be2e-01351e52e036/copy-manifests/0.log" Jun 12 19:24:51.294588 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:51.294561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-r9msm_41ddf843-f642-4e17-be2e-01351e52e036/manager/0.log" Jun 12 19:24:52.436577 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:52.436548 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb_3f3ac761-4b3e-4d2e-b3e1-5de24136105b/util/0.log" Jun 12 19:24:52.443641 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:52.443616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb_3f3ac761-4b3e-4d2e-b3e1-5de24136105b/pull/0.log" Jun 12 19:24:52.449643 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:52.449624 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb_3f3ac761-4b3e-4d2e-b3e1-5de24136105b/extract/0.log" Jun 12 19:24:52.689515 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:52.689434 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f8576bbd-wmvcp_2167b0d4-be6e-49df-8041-b107c6b05f1d/authorino/0.log" Jun 12 19:24:53.050143 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:53.050048 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nr9hb_bc6d89cc-a7c9-46ad-ade8-be88cfe8832b/kuadrant-console-plugin/0.log" Jun 12 19:24:53.449863 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:53.449834 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bs2dl_7c1f1171-6360-477d-9d37-5cfaf0da32ec/limitador/0.log" Jun 12 19:24:54.271928 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:54.271897 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-t2ddn_82d4f58a-5084-4ec6-948c-bc154ac897ab/kube-auth-proxy/0.log" Jun 12 19:24:55.259209 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:55.259182 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7z5jt_268507fe-e1fe-4a4e-b488-71c75e3ac93c/storage-initializer/0.log" Jun 12 19:24:55.269628 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:55.269607 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7z5jt_268507fe-e1fe-4a4e-b488-71c75e3ac93c/main/0.log" Jun 12 19:24:55.387421 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:55.387391 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452_24dab97e-76da-4b4a-81be-4051bf3c232d/storage-initializer/0.log" Jun 12 19:24:55.396190 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:55.396152 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-z5452_24dab97e-76da-4b4a-81be-4051bf3c232d/main/0.log" Jun 12 19:24:55.775367 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:55.775339 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j5cwr_beb5c9a2-62ed-48ee-a3a9-ced77a224271/storage-initializer/0.log" Jun 12 19:24:55.783077 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:24:55.783053 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-j5cwr_beb5c9a2-62ed-48ee-a3a9-ced77a224271/main/0.log" Jun 12 19:25:02.835213 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:02.835178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cb2mv_dd46d5fa-ce73-485b-b729-4be45deaf694/global-pull-secret-syncer/0.log" Jun 12 19:25:03.007417 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:03.007385 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qpswc_cff61510-503c-4955-b1e2-9c6a80d24e8e/konnectivity-agent/0.log" Jun 12 19:25:03.029262 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:03.029230 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-145.ec2.internal_f5f57386a7aab263f3254ec2336712d8/haproxy/0.log" Jun 12 19:25:07.155714 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:07.155665 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb_3f3ac761-4b3e-4d2e-b3e1-5de24136105b/extract/0.log" Jun 12 19:25:07.180475 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:07.180439 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb_3f3ac761-4b3e-4d2e-b3e1-5de24136105b/util/0.log" Jun 12 19:25:07.204214 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:07.204191 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73brchb_3f3ac761-4b3e-4d2e-b3e1-5de24136105b/pull/0.log" Jun 12 19:25:07.513785 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:07.513690 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f8576bbd-wmvcp_2167b0d4-be6e-49df-8041-b107c6b05f1d/authorino/0.log" Jun 12 19:25:07.637701 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:07.637672 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nr9hb_bc6d89cc-a7c9-46ad-ade8-be88cfe8832b/kuadrant-console-plugin/0.log" Jun 12 19:25:07.880606 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:07.880576 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bs2dl_7c1f1171-6360-477d-9d37-5cfaf0da32ec/limitador/0.log" Jun 12 19:25:09.526279 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.526246 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bb778a5-b2ee-4b44-aeff-97ee227fccdc/alertmanager/0.log" Jun 12 19:25:09.584939 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.584910 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bb778a5-b2ee-4b44-aeff-97ee227fccdc/config-reloader/0.log" Jun 12 19:25:09.630300 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.630264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bb778a5-b2ee-4b44-aeff-97ee227fccdc/kube-rbac-proxy-web/0.log" Jun 12 19:25:09.667392 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.667361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bb778a5-b2ee-4b44-aeff-97ee227fccdc/kube-rbac-proxy/0.log" Jun 12 19:25:09.721951 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.721921 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bb778a5-b2ee-4b44-aeff-97ee227fccdc/kube-rbac-proxy-metric/0.log" Jun 12 19:25:09.754505 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.754476 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bb778a5-b2ee-4b44-aeff-97ee227fccdc/prom-label-proxy/0.log" Jun 12 19:25:09.781467 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.781394 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bb778a5-b2ee-4b44-aeff-97ee227fccdc/init-config-reloader/0.log" Jun 12 19:25:09.988496 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:09.988465 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-2xp7r_b511fa76-2d99-40eb-a1c2-9656e8946d4a/monitoring-plugin/0.log" Jun 12 19:25:10.228451 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.228424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x86r_057d930b-506e-4429-9c96-0f6bee836424/node-exporter/0.log" Jun 12 19:25:10.257496 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.257467 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x86r_057d930b-506e-4429-9c96-0f6bee836424/kube-rbac-proxy/0.log" Jun 12 19:25:10.285840 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.285813 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x86r_057d930b-506e-4429-9c96-0f6bee836424/init-textfile/0.log" Jun 12 19:25:10.317962 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.317937 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72d8z_59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9/kube-rbac-proxy-main/0.log" Jun 12 19:25:10.346371 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.346349 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72d8z_59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9/kube-rbac-proxy-self/0.log" Jun 12 19:25:10.372164 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.372135 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-72d8z_59ab00b2-ed88-4aa6-8ceb-b1b75d50e3e9/openshift-state-metrics/0.log" Jun 12 19:25:10.719246 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.719214 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-rxh2g_6602361d-50a9-450c-8ab7-4f75410c1829/prometheus-operator-admission-webhook/0.log" Jun 12 19:25:10.751505 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.751480 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7fd99c69-2trjv_193f73ed-438b-4722-8ded-ccd055f4a43b/telemeter-client/0.log" Jun 12 19:25:10.776784 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.776752 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7fd99c69-2trjv_193f73ed-438b-4722-8ded-ccd055f4a43b/reload/0.log" Jun 12 19:25:10.800249 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:10.800219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7fd99c69-2trjv_193f73ed-438b-4722-8ded-ccd055f4a43b/kube-rbac-proxy/0.log" Jun 12 19:25:14.505165 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.505120 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q"] Jun 12 19:25:14.505600 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.505520 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60044c29-0574-48ec-b3f4-4efd0adc57da" containerName="authorino" Jun 12 19:25:14.505600 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.505534 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="60044c29-0574-48ec-b3f4-4efd0adc57da" containerName="authorino" Jun 12 19:25:14.505687 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.505602 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="60044c29-0574-48ec-b3f4-4efd0adc57da" containerName="authorino" Jun 12 19:25:14.508650 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.508629 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.511368 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.511344 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87vbw\"/\"openshift-service-ca.crt\"" Jun 12 19:25:14.511368 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.511363 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-87vbw\"/\"default-dockercfg-9jh5s\"" Jun 12 19:25:14.512650 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.512631 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87vbw\"/\"kube-root-ca.crt\"" Jun 12 19:25:14.519621 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.519598 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q"] Jun 12 19:25:14.629887 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.629847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-proc\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.629887 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.629891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvnvk\" (UniqueName: \"kubernetes.io/projected/98f86859-b590-463a-9abc-94703fd51763-kube-api-access-bvnvk\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.630133 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.629921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-sys\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.630133 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.630002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-lib-modules\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.630133 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.630074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-podres\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730589 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-podres\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730787 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-proc\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730787 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvnvk\" (UniqueName: \"kubernetes.io/projected/98f86859-b590-463a-9abc-94703fd51763-kube-api-access-bvnvk\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730787 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-sys\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730787 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-lib-modules\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730787 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-podres\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730787 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-proc\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.730787 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730770 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-sys\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.731051 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.730859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98f86859-b590-463a-9abc-94703fd51763-lib-modules\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.738926 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.738899 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvnvk\" (UniqueName: \"kubernetes.io/projected/98f86859-b590-463a-9abc-94703fd51763-kube-api-access-bvnvk\") pod \"perf-node-gather-daemonset-88p6q\" (UID: \"98f86859-b590-463a-9abc-94703fd51763\") " pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.819482 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.819381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:14.957154 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:14.957127 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q"] Jun 12 19:25:14.959549 ip-10-0-129-145 kubenswrapper[2574]: W0612 19:25:14.959511 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98f86859_b590_463a_9abc_94703fd51763.slice/crio-c50d896377364f2b757c5763083318962d62dadffa35e78b3271ba9730de2d11 WatchSource:0}: Error finding container c50d896377364f2b757c5763083318962d62dadffa35e78b3271ba9730de2d11: Status 404 returned error can't find the container with id c50d896377364f2b757c5763083318962d62dadffa35e78b3271ba9730de2d11 Jun 12 19:25:15.459514 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:15.459475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" event={"ID":"98f86859-b590-463a-9abc-94703fd51763","Type":"ContainerStarted","Data":"f66d55624684ae03ea643178c0a4eaa41a2fde3f13bb4edfe2db4e7e75ca099d"} Jun 12 19:25:15.459766 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:15.459537 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" event={"ID":"98f86859-b590-463a-9abc-94703fd51763","Type":"ContainerStarted","Data":"c50d896377364f2b757c5763083318962d62dadffa35e78b3271ba9730de2d11"} Jun 12 19:25:15.459766 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:15.459621 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:15.476764 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:15.476709 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" podStartSLOduration=1.476693209 podStartE2EDuration="1.476693209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:15.475183784 +0000 UTC m=+2572.641577948" watchObservedRunningTime="2026-06-12 19:25:15.476693209 +0000 UTC m=+2572.643087370" Jun 12 19:25:15.757642 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:15.757564 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsklz_659110db-f8d3-454b-a50d-66a0b0ab4047/dns/0.log" Jun 12 19:25:15.781546 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:15.781521 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tsklz_659110db-f8d3-454b-a50d-66a0b0ab4047/kube-rbac-proxy/0.log" Jun 12 19:25:15.910557 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:15.910527 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bdd45_ef686d13-2ae1-4214-b106-af9b65a6d82d/dns-node-resolver/0.log" Jun 12 19:25:16.454280 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:16.454225 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-569f6597b-r6jjd_577378d3-e3ab-450e-9958-481dbf218b7e/registry/0.log" Jun 12 19:25:16.464899 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:16.464868 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-569f6597b-r6jjd_577378d3-e3ab-450e-9958-481dbf218b7e/registry/1.log" Jun 12 19:25:16.514919 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:16.514891 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-czvqp_ffd37509-b8ff-4538-af18-a925ba1bb75f/node-ca/0.log" Jun 12 19:25:17.740845 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:17.740812 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-t2ddn_82d4f58a-5084-4ec6-948c-bc154ac897ab/kube-auth-proxy/0.log" Jun 12 19:25:18.690182 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:18.690150 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nlrz5_0623f7c3-6e0b-4e8f-9f75-9a7fff0b5ba2/serve-healthcheck-canary/0.log" Jun 12 19:25:19.257887 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:19.257858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2s6cr_c8f41bbf-4e71-47b3-8138-4e0d18cd40ba/kube-rbac-proxy/0.log" Jun 12 19:25:19.282628 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:19.282590 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2s6cr_c8f41bbf-4e71-47b3-8138-4e0d18cd40ba/exporter/0.log" Jun 12 19:25:19.306424 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:19.306398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2s6cr_c8f41bbf-4e71-47b3-8138-4e0d18cd40ba/extractor/0.log" Jun 12 19:25:21.474721 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:21.474691 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-87vbw/perf-node-gather-daemonset-88p6q" Jun 12 19:25:22.471173 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:22.471147 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-r9msm_41ddf843-f642-4e17-be2e-01351e52e036/manager/0.log" Jun 12 19:25:22.493482 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:22.493451 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-ffbc465cb-r9msm_41ddf843-f642-4e17-be2e-01351e52e036/copy-manifests/0.log" Jun 12 19:25:24.277920 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:24.277891 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-776cbdb69d-q6tgk_3c2b3a32-9899-47f2-8fcd-5e21b7feaba4/manager/0.log" Jun 12 19:25:27.520526 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:27.520495 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-t2ddn_82d4f58a-5084-4ec6-948c-bc154ac897ab/kube-auth-proxy/0.log" Jun 12 19:25:29.065166 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:29.065132 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-t2ddn_82d4f58a-5084-4ec6-948c-bc154ac897ab/kube-auth-proxy/0.log" Jun 12 19:25:30.091813 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:30.091783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-b9sm2_0588f18a-7918-4c8a-bf48-30e74ce62e00/kube-storage-version-migrator-operator/1.log" Jun 12 19:25:30.092702 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:30.092688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-b9sm2_0588f18a-7918-4c8a-bf48-30e74ce62e00/kube-storage-version-migrator-operator/0.log" Jun 12 19:25:31.171605 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.171520 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8b58c9c7-t2ddn_82d4f58a-5084-4ec6-948c-bc154ac897ab/kube-auth-proxy/0.log" Jun 12 19:25:31.485659 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.485573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw92f_fff23fb8-4ee0-4558-8324-907b4d02a3e8/kube-multus-additional-cni-plugins/0.log" Jun 12 19:25:31.511123 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.511093 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw92f_fff23fb8-4ee0-4558-8324-907b4d02a3e8/egress-router-binary-copy/0.log" Jun 12 19:25:31.538472 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.538437 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw92f_fff23fb8-4ee0-4558-8324-907b4d02a3e8/cni-plugins/0.log" Jun 12 19:25:31.562146 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.562120 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw92f_fff23fb8-4ee0-4558-8324-907b4d02a3e8/bond-cni-plugin/0.log" Jun 12 19:25:31.586076 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.586047 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw92f_fff23fb8-4ee0-4558-8324-907b4d02a3e8/routeoverride-cni/0.log" Jun 12 19:25:31.608930 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.608903 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw92f_fff23fb8-4ee0-4558-8324-907b4d02a3e8/whereabouts-cni-bincopy/0.log" Jun 12 19:25:31.634413 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.634385 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw92f_fff23fb8-4ee0-4558-8324-907b4d02a3e8/whereabouts-cni/0.log" Jun 12 19:25:31.886773 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:31.886745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z6zzh_96519635-dda3-4b18-9630-97116a6ec75b/kube-multus/0.log" Jun 12 19:25:32.007860 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:32.007830 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrm78_b127fdb1-7fb1-457b-b4f1-2906e66966da/network-metrics-daemon/0.log" Jun 12 19:25:32.031328 ip-10-0-129-145 kubenswrapper[2574]: I0612 19:25:32.031276 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrm78_b127fdb1-7fb1-457b-b4f1-2906e66966da/kube-rbac-proxy/0.log"